Sep 23 00:04:53 devstack cinder-volume[75412]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:04:53 devstack cinder-volume[75412]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:04:53 devstack cinder-volume[75412]: we strongly recommend against using it for new projects. Sep 23 00:04:53 devstack cinder-volume[75412]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:04:53 devstack cinder-volume[75412]: framework. For more detail see Sep 23 00:04:53 devstack cinder-volume[75412]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:04:53 devstack cinder-volume[75412]: import eventlet # noqa Sep 23 00:04:56 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:04:56 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:04:56 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:04:57 devstack cinder-volume[75412]: INFO dbcounter [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Registered counter for database cinder Sep 23 00:04:57 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:57 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writer thread running {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:04:57 devstack cinder-volume[75412]: INFO cinder.rpc [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.rpc [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Determined volume DB was empty at startup. Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG cinder.volume.manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:04:58 devstack cinder-volume[75412]: WARNING stevedore.named [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:04:58 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:58 devstack cinder-volume[75412]: WARNING cinder.keymgr.conf_key_mgr [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG cinder.volume.drivers.lvm [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] CMD "cinder-rtstool verify" returned: 0 in 0.474s {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.rpc [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.rpc [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:04:58 devstack cinder-volume[75412]: WARNING stevedore.named [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:04:58 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:58 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:58 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Starting 1 workers Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Started child 75576 {{(pid=75412) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Full set of CONF: {{(pid=75412) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Configuration options gathered from: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] ================================================================================ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] allow_availability_zone_fallback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] allow_compression_on_image_upload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] allowed_direct_url_schemes = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] api_rate_limit = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] auth_strategy = keystone {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] az_cache_duration = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_host = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_stats_polling_interval = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backup_api_class = cinder.backup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backup_name_template = backup-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backup_use_same_host = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backup_use_temp_snapshot = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] chap_username = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75576]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_internal_tenant_project_id = 5564adfdc4d24e96814d35e8813c8b23 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_internal_tenant_user_id = d285b0992df1412ab6098503787a1e5e {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cloned_volume_same_az = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cluster = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] compression_format = gzip {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] compute_api_class = cinder.compute.nova.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] config_dir = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] config_source = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] control_exchange = openstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] debug = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] default_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] default_group_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] default_volume_type = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] deployment_max_gigabytes = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_ssl_cert_verify = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] driver_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] enable_force_upload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] enable_new_services = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] enable_unsupported_driver = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_api_insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_api_ssl_compression = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_ca_certificates_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_catalog_info = image:glance:publicURL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_num_retries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance_request_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] graceful_shutdown_timeout = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] group_api_class = cinder.group.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] host = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_compress_on_upload = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_conversion_address_space_limit = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_conversion_cpu_limit = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_conversion_disable = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_introspection_address_space_limit = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_introspection_cpu_limit = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_volume_cache_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_volume_cache_max_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] init_host_max_objects_retrieval = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] instance_format = [instance: %(uuid)s] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iscsi_target_flags = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iscsi_write_cache = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iser_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iser_ip_address = 192.168.122.137 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iser_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_color = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_config_append = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_options = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_rotate_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_rotate_interval_type = days {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] log_rotation_type = none {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] max_age = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] max_logfile_count = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] max_logfile_size_mb = 200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] max_over_subscription_ratio = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] message_reap_interval = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] message_ttl = 2592000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] migration_create_volume_timeout_secs = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] monkey_patch = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] monkey_patch_modules = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] my_ip = 192.168.122.137 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] no_snapshot_gb_quota = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] num_iser_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] num_shell_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] num_volume_device_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] nvmeof_conn_info_version = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] nvmet_ns_id = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] nvmet_port_id = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_max_limit = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_ext_list = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_listen_port = 8776 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] osapi_volume_workers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] per_volume_size_limit = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] periodic_fuzzy_delay = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] periodic_interval = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:58 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] public_endpoint = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] publish_errors = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_backup_gigabytes = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_backups = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_gigabytes = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_groups = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_snapshots = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] quota_volumes = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] rate_limit_burst = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] rate_limit_except_level = CRITICAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] rate_limit_interval = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] reinit_driver_count = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] report_discard_supported = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] report_interval = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] reservation_clean_interval = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] reservation_expire = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] reserved_image_namespaces = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] reserved_percentage = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] rpc_response_timeout = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] run_external_periodic_tasks = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] scst_target_driver = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_down_time = 720 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] shell_completion = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] snapshot_name_template = snapshot-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] snapshot_same_host = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] state_path = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] storage_availability_zone = nova {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] storage_protocol = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] syslog_log_facility = LOG_USER {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_helper = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_ip_address = 192.168.122.137 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] target_secondary_ip_addresses = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] transport_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] until_refresh = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_chap_auth = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_default_quota_class = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_journal = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_json = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_stderr = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] use_syslog = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] verify_glance_signatures = enabled {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_api_class = cinder.volume.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_clear_size = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_copy_bps_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_dd_blocksize = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_name_template = volume-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_service_inithost_offload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volume_usage_audit_period = month {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] zoning_mode = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_concurrency.disable_process_locking = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.auth_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.cache = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.include_service_catalog = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.interface = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcache_username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.service_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.backend = dogpile.cache.null {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.backend_argument = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.backend_expiration_time = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.config_prefix = cache.oslo {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.debug_cache_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.enable_retry_client = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.enable_socket_keepalive = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.expiration_time = 600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.hashclient_retry_attempts = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_dead_retry = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_pool_maxsize = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_sasl_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.proxies = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.redis_db = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.redis_server = localhost:6379 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.retry_attempts = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.retry_delay = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.socket_keepalive_count = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.socket_keepalive_idle = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.socket_keepalive_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.socket_timeout = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.tls_allowed_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.tls_cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.tls_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.tls_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.tls_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cache.username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] coordination.backend_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.asyncio_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.asyncio_slave_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.backend = sqlalchemy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.connection_debug = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.connection_parameters = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.connection_recycle_time = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.connection_trace = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.db_inc_retry_interval = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.db_max_retries = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.db_max_retry_interval = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.db_retry_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.max_overflow = 50 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.max_pool_size = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.max_retries = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.mysql_wsrep_sync_wait = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.pool_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.retry_interval = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.slave_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.sqlite_synchronous = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.synchronous_reader = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] database.use_db_reconnect = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_tracing.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.connection_string = messaging:// {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.es_doc_type = notification {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.es_scroll_size = 10000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.es_scroll_time = 2m {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.filter_error_trace = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.hmac_keys = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.socket_timeout = 0.1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.trace_requests = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler.trace_sqlalchemy = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler_jaeger.process_tags = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler_jaeger.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] profiler_otlp.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack sudo[75581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.enforce_new_defaults = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack sudo[75581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.policy_default_rule = default {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.policy_file = policy.yaml {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.group = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] privsep_osbrick.user = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.group = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] cinder_sys_admin.user = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.send_service_user_token = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] service_user.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.auth_type = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] glance.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.chap_username = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.driver_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.extra_capabilities = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iscsi_target_flags = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iscsi_write_cache = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iser_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iser_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.lvm_share_target = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.lvm_type = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.num_shell_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.report_discard_supported = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.reserved_percentage = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.unique_fqdn_network = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.use_chap_auth = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_clear_size = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_reports.file_event_handler = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_reports.log_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.backend_host = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.chap_username = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.extra_capabilities = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iser_helper = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iser_ip_address = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iser_port = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.lvm_share_target = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.lvm_type = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.num_shell_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.report_discard_supported = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.reserved_percentage = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.scst_target_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.storage_protocol = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_helper = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_ip_address = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_port = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.trace_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.use_chap_auth = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_clear = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_clear_size = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] lvmdriver-1.volumes_dir = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack sudo[75581]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.393s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_notifications.driver = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_notifications.retry = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] key_manager.fixed_key = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.barbican_api_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.barbican_endpoint = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.barbican_endpoint_type = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.barbican_region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.number_of_retries = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.retry_delay = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.send_service_user_token = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.verify_ssl = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican.verify_ssl_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.auth_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack sudo[75584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:59 devstack sudo[75584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.tls_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] barbican_service_user.tls_min_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.approle_role_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.approle_secret_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.auth_method = approle {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.auth_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.kv_mountpoint = secret {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.kv_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.kv_version = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.root_token_id = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.ssl_ca_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.timeout = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.token_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.token_role = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:59 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:04:59 devstack sudo[75584]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.310s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:04:59 devstack cinder-volume[75576]: INFO cinder.brick.local_dev.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:59 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:59 devstack sudo[75700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:59 devstack sudo[75700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:00 devstack sudo[75700]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG cinder.brick.local_dev.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75576) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:00 devstack sudo[75811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:00 devstack sudo[75811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:00 devstack sudo[75811]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:00 devstack sudo[76010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:00 devstack sudo[76010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:00 devstack sudo[76010]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:00 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:00 devstack sudo[76102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:05:00 devstack sudo[76102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:01 devstack sudo[76102]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.331s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:01 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:01 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:01 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:01 devstack sudo[76198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:01 devstack sudo[76198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:01 devstack sudo[76198]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:01 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:01 devstack sudo[76281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:01 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:02 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:02 devstack sudo[76290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:02 devstack sudo[76290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:02 devstack sudo[76290]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:02 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:02 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:02 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:02 devstack cinder-volume[75576]: INFO cinder.volume.drivers.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:02 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:02 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:02 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:03 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:03 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:03 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:03 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:03 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:03 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:03 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:03 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:03 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:03 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:03 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:03 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:03 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:04 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:04 devstack cinder-volume[75576]: INFO cinder.volume.driver [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG cinder.volume.driver [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75576) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_db.sqlalchemy.engines [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writer thread running {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG cinder.db.api [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Building query based on filter {{(pid=75576) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3973}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG cinder.image.image_utils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75576) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:05:04 devstack cinder-volume[75576]: INFO cinder.keymgr.migration [None req-69f1f20b-a00e-46b1-b625-c2312daca762 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:04 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:04 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:04 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:04 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:04 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:04 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:04 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:04 devstack sudo[76409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:04 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:05 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:05 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:05 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG cinder.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Notifying Schedulers of capabilities ... {{(pid=75576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:05 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Driver initialization completed successfully. Sep 23 00:05:05 devstack cinder-volume[75576]: INFO cinder.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Initiating service 2 cleanup Sep 23 00:05:05 devstack cinder-volume[75576]: INFO cinder.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Service 2 cleanup completed. Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG cinder.service [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Creating RPC server for service cinder-volume {{(pid=75576) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG cinder.service [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75576) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:05:05 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack sudo[76416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:05 devstack sudo[76416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:05 devstack sudo[76416]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:05 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:05 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:06 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack sudo[76430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:06 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75576]: INFO cinder.volume.manager [None req-89e5a40d-5d19-4fff-8c64-acc3a5f7c653 None None] Driver post RPC initialization completed successfully. Sep 23 00:05:08 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=5 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:18 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager._thread_info {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:05:18 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread count: 6 {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:05:18 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread info: [<_MainThread(MainThread, started 140270145790080)>, , , , , ] {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:06:18 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:18 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:06:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:18 devstack sudo[78507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:06:18 devstack sudo[78507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:18 devstack sudo[78507]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[78608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:19 devstack sudo[78608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:19 devstack sudo[78608]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[78611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:06:19 devstack sudo[78611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:19 devstack sudo[78611]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:19 devstack sudo[78614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:19 devstack sudo[78614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:19 devstack sudo[78614]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG cinder.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Notifying Schedulers of capabilities ... {{(pid=75576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager._thread_info {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread count: 6 {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:06:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread info: [<_MainThread(MainThread, started 140270145790080)>, , , , , ] {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:07:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:UPDATE=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:07:18 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:18 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:18 devstack sudo[81855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:18 devstack sudo[81855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:18 devstack sudo[81855]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[81859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:19 devstack sudo[81859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:19 devstack sudo[81859]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[81866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:19 devstack sudo[81866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:19 devstack sudo[81866]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:19 devstack sudo[81870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:19 devstack sudo[81870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:19 devstack sudo[81870]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:19 devstack cinder-volume[75576]: DEBUG cinder.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Notifying Schedulers of capabilities ... {{(pid=75576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:18 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:18 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:18 devstack sudo[83870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:18 devstack sudo[83870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:18 devstack sudo[83870]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:19 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:19 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:19 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:19 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:19 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:19 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:19 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG cinder.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Notifying Schedulers of capabilities ... {{(pid=75576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager._thread_info {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread count: 6 {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:08:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread info: [<_MainThread(MainThread, started 140270145790080)>, , , , , ] {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:09:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:SELECT=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:16 devstack cinder-volume[75576]: DEBUG dbcounter [-] [75576] Writing DB stats cinder:UPDATE=1 {{(pid=75576) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:18 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:18 devstack cinder-volume[75576]: DEBUG cinder.volume.drivers.lvm [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Updating volume stats {{(pid=75576) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:09:18 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:18 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:09:18 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:19 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:19 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:19 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:19 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:19 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:09:19 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:19 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:19 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:19 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:19 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_concurrency.processutils [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75576) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG cinder.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Notifying Schedulers of capabilities ... {{(pid=75576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG oslo_service.periodic_task [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] Running periodic task VolumeManager._thread_info {{(pid=75576) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread count: 6 {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:09:19 devstack cinder-volume[75576]: DEBUG cinder.volume.manager [None req-6b8eb6df-4d5e-49b4-aa9f-975496a0b795 None None] thread info: [<_MainThread(MainThread, started 140270145790080)>, , , , , ] {{(pid=75576) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:09:44 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Caught SIGTERM, stopping children Sep 23 00:09:44 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:44 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:44 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:44 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Stop services. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:09:44 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Killing children. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:09:44 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Waiting on 1 children to exit Sep 23 00:09:45 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Acquiring lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:45 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Acquired lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:45 devstack cinder-volume[75576]: DEBUG oslo_concurrency.lockutils [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Releasing lock "singleton_lock" {{(pid=75576) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:45 devstack cinder-volume[75576]: WARNING amqp [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:45 devstack cinder-volume[75576]: WARNING amqp [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:45 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-a5749347-0a4a-4bb3-b3ef-5229c233aa88 None None] Child 75576 exited with status 0 Sep 23 00:09:46 devstack cinder-volume[85611]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:09:46 devstack cinder-volume[85611]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:09:46 devstack cinder-volume[85611]: we strongly recommend against using it for new projects. Sep 23 00:09:46 devstack cinder-volume[85611]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:09:46 devstack cinder-volume[85611]: framework. For more detail see Sep 23 00:09:46 devstack cinder-volume[85611]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:09:46 devstack cinder-volume[85611]: import eventlet # noqa Sep 23 00:09:48 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:48 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:48 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:48 devstack cinder-volume[85611]: INFO dbcounter [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Registered counter for database cinder Sep 23 00:09:48 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG dbcounter [-] [85611] Writer thread running {{(pid=85611) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:49 devstack cinder-volume[85611]: INFO cinder.rpc [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:09:49 devstack cinder-volume[85611]: INFO cinder.rpc [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:49 devstack cinder-volume[85611]: INFO cinder.volume.manager [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Determined volume DB was empty at startup. Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG cinder.volume.manager [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85611) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:09:49 devstack cinder-volume[85611]: INFO cinder.volume.manager [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:09:49 devstack cinder-volume[85611]: WARNING stevedore.named [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:09:49 devstack cinder-volume[85611]: WARNING castellan.key_manager [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:49 devstack cinder-volume[85611]: WARNING cinder.keymgr.conf_key_mgr [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:49 devstack cinder-volume[85611]: INFO cinder.volume.manager [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:49 devstack cinder-volume[85611]: INFO oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Starting 1 workers Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Started child 85876 {{(pid=85611) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Full set of CONF: {{(pid=85611) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] ******************************************************************************** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Configuration options gathered from: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:09:49 devstack cinder-volume[85876]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] ================================================================================ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] allow_availability_zone_fallback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] allow_compression_on_image_upload = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] allowed_direct_url_schemes = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] api_rate_limit = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] auth_strategy = keystone {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_stats_polling_interval = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backup_api_class = cinder.backup.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backup_name_template = backup-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backup_use_same_host = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backup_use_temp_snapshot = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] chap_username = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_internal_tenant_project_id = 5564adfdc4d24e96814d35e8813c8b23 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_internal_tenant_user_id = d285b0992df1412ab6098503787a1e5e {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cluster = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] compression_format = gzip {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] compute_api_class = cinder.compute.nova.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] config_dir = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] config_source = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] control_exchange = openstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] debug = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] default_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] default_group_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] default_volume_type = QuobyteHD {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] deployment_max_gigabytes = -1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_ssl_cert_verify = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] driver_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] enable_new_services = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] enable_unsupported_driver = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] enabled_backends = ['QuobyteHD'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] enforce_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_api_insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_api_ssl_compression = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_ca_certificates_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_catalog_info = image:glance:publicURL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_num_retries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance_request_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] graceful_shutdown_timeout = 5 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] group_api_class = cinder.group.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] host = devstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_compress_on_upload = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_conversion_address_space_limit = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_conversion_cpu_limit = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_conversion_disable = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_introspection_address_space_limit = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_introspection_cpu_limit = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_upload_use_cinder_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_upload_use_internal_tenant = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_volume_cache_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_volume_cache_max_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] image_volume_cache_max_size_gb = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] init_host_max_objects_retrieval = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] instance_format = [instance: %(uuid)s] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iscsi_target_flags = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iscsi_write_cache = on {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iser_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iser_ip_address = 192.168.122.137 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iser_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_color = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_config_append = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_options = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_rotate_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_rotate_interval_type = days {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] log_rotation_type = none {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] max_age = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] max_logfile_count = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] max_logfile_size_mb = 200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] max_over_subscription_ratio = 20.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] message_reap_interval = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] message_ttl = 2592000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] migration_create_volume_timeout_secs = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] monkey_patch = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] monkey_patch_modules = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] my_ip = 192.168.122.137 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] no_snapshot_gb_quota = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] num_iser_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] num_shell_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] num_volume_device_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] nvmeof_conn_info_version = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] nvmet_ns_id = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] nvmet_port_id = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_max_limit = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_ext_list = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_listen = 0.0.0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_listen_port = 8776 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] osapi_volume_workers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] per_volume_size_limit = -1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] periodic_fuzzy_delay = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] periodic_interval = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] project_id_regex = [0-9a-f\-]+ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] public_endpoint = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] publish_errors = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_backup_gigabytes = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_backups = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_gigabytes = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_groups = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_snapshots = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] quota_volumes = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] rate_limit_burst = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] rate_limit_except_level = CRITICAL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] rate_limit_interval = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] reinit_driver_count = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] report_discard_supported = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] report_interval = 120 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] reservation_clean_interval = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] reservation_expire = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] reserved_image_namespaces = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] reserved_percentage = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] rpc_response_timeout = 120 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] run_external_periodic_tasks = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] scst_target_driver = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_down_time = 720 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] shell_completion = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] snapshot_name_template = snapshot-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] state_path = /opt/stack/data/cinder {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] storage_availability_zone = nova {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] storage_protocol = iSCSI {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] syslog_log_facility = LOG_USER {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_helper = lioadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_ip_address = 192.168.122.137 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_protocol = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] target_secondary_ip_addresses = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] transfer_api_class = cinder.transfer.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] transport_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] until_refresh = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_chap_auth = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_default_quota_class = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_journal = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_json = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_stderr = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] use_syslog = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] verify_glance_signatures = enabled {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_api_class = cinder.volume.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_clear = zero {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_clear_size = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_copy_bps_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_dd_blocksize = 1M {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_name_template = volume-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_service_inithost_offload = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volume_usage_audit_period = month {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] zoning_mode = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:49 devstack cinder-volume[85876]: INFO cinder.volume.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:09:49 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85876) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_concurrency.disable_process_locking = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.auth_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.delay_auth_decision = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.http_connect_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.include_service_catalog = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.interface = public {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcache_username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.service_token_roles_required = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.service_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.token_cache_time = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.backend = dogpile.cache.null {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.backend_argument = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.backend_expiration_time = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.config_prefix = cache.oslo {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.debug_cache_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.enable_retry_client = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.enable_socket_keepalive = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.expiration_time = 600 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.hashclient_retry_attempts = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_dead_retry = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_pool_maxsize = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_sasl_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.proxies = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.redis_db = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.redis_sentinel_service_name = mymaster {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.redis_server = localhost:6379 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.retry_attempts = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.retry_delay = 0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.socket_keepalive_count = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.socket_keepalive_idle = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.socket_keepalive_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.socket_timeout = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.tls_allowed_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.tls_cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.tls_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.tls_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.tls_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cache.username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] coordination.backend_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.asyncio_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.asyncio_slave_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.backend = sqlalchemy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.connection_debug = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.connection_parameters = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.connection_recycle_time = 3600 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.connection_trace = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.db_inc_retry_interval = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.db_max_retries = 20 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.db_max_retry_interval = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.db_retry_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.max_overflow = 50 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.max_pool_size = 5 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.max_retries = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.mysql_wsrep_sync_wait = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.pool_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.retry_interval = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.slave_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.sqlite_synchronous = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.synchronous_reader = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] database.use_db_reconnect = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_tracing.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.connection_string = messaging:// {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.es_doc_type = notification {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.es_scroll_size = 10000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.es_scroll_time = 2m {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.filter_error_trace = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.hmac_keys = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.sentinel_service_name = mymaster {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.socket_timeout = 0.1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.trace_requests = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler.trace_sqlalchemy = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler_jaeger.process_tags = {} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler_jaeger.service_name_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] profiler_otlp.service_name_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.enforce_new_defaults = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.policy_default_rule = default {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.policy_file = policy.yaml {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_policy.remote_timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.group = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.helper_command = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] privsep_osbrick.user = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:49 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.group = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.helper_command = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] cinder_sys_admin.user = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85876) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.send_service_user_token = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] service_user.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: WARNING cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:09:50 devstack cinder-volume[85876]: WARNING cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Running cmd (subprocess): mount.quobyte {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] glance.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.chap_username = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.driver_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.enable_unsupported_driver = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.extra_capabilities = {} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iscsi_target_flags = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iscsi_write_cache = on {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iser_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iser_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_host = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_login = admin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_mount_options = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_private_key = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_share_path = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_ssh_port = 22 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.num_shell_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.nvmet_port_id = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_client_cfg = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.quobyte_volume_url = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.report_discard_supported = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.reserved_percentage = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.scst_target_driver = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.storage_protocol = iSCSI {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_protocol = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.unique_fqdn_network = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.use_chap_auth = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_clear = zero {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_clear_size = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_reports.file_event_handler = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_reports.log_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.backend_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.chap_username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.chiscsi_conf = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.driver_use_ssl = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.extra_capabilities = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iscsi_target_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iscsi_write_cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iser_helper = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iser_ip_address = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iser_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.iser_target_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_login = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_mount_options = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_private_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_share_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_ssh_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.num_shell_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nvmet_ns_id = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.nvmet_port_id = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.report_discard_supported = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.reserved_percentage = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.scst_target_driver = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.storage_protocol = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_helper = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_ip_address = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_protocol = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.unique_fqdn_network = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.use_chap_auth = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_clear = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_clear_size = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] QuobyteHD.volumes_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.ssl_version = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_notifications.driver = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_notifications.retry = -1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] oslo_messaging_notifications.transport_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=85876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] key_manager.fixed_key = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.barbican_api_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.barbican_endpoint = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.barbican_endpoint_type = public {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.barbican_region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: INFO cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 ... Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f -c /etc/quobyte/client-cinder.cfg {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.number_of_retries = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.retry_delay = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.send_service_user_token = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.verify_ssl = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican.verify_ssl_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.auth_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] barbican_service_user.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.approle_role_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.approle_secret_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.auth_method = approle {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.auth_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.kv_mountpoint = secret {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.kv_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.kv_version = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.root_token_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.ssl_ca_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.token_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.token_role = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:50 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] ******************************************************************************** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:09:50 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f -c /etc/quobyte/client-cinder.cfg Sep 23 00:09:50 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:50 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.444s {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:50 devstack cinder-volume[85876]: INFO cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 succeeded Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=85876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.460s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:50 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:09:50 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:50 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.267s {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:50 devstack cinder-volume[85876]: INFO cinder.volume.driver [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.driver [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85876) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_db.sqlalchemy.engines [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG dbcounter [-] [85876] Writer thread running {{(pid=85876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.db.api [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Building query based on filter {{(pid=85876) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3973}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.image.image_utils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85876) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:09:50 devstack cinder-volume[85876]: INFO cinder.keymgr.migration [None req-3f188ae0-0659-4d77-871c-7f7f2afe4dfa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=85876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=85876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:50 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:51 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:09:51 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:51 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.270s {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG cinder.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Notifying Schedulers of capabilities ... {{(pid=85876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:51 devstack cinder-volume[85876]: INFO cinder.volume.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Driver initialization completed successfully. Sep 23 00:09:51 devstack cinder-volume[85876]: INFO cinder.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Initiating service 3 cleanup Sep 23 00:09:51 devstack cinder-volume[85876]: INFO cinder.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Service 3 cleanup completed. Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG cinder.service [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Creating RPC server for service cinder-volume {{(pid=85876) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG cinder.service [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85876) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:09:51 devstack cinder-volume[85876]: INFO cinder.volume.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=85876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=85876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:51 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:09:51 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:51 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:51 devstack cinder-volume[85876]: DEBUG oslo_concurrency.processutils [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.313s {{(pid=85876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:51 devstack cinder-volume[85876]: INFO cinder.volume.manager [None req-0f8a70da-e684-49f9-bc9b-31e4702bcf92 None None] Driver post RPC initialization completed successfully. Sep 23 00:09:56 devstack cinder-volume[85611]: INFO oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Caught SIGTERM, stopping children Sep 23 00:09:56 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Acquiring lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:56 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Acquired lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:56 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Releasing lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:56 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Stop services. {{(pid=85611) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:09:56 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Killing children. {{(pid=85611) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:09:56 devstack cinder-volume[85611]: INFO oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Waiting on 1 children to exit Sep 23 00:09:59 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Acquiring lock "singleton_lock" {{(pid=85876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:59 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Acquired lock "singleton_lock" {{(pid=85876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:59 devstack cinder-volume[85876]: DEBUG oslo_concurrency.lockutils [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Releasing lock "singleton_lock" {{(pid=85876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:59 devstack cinder-volume[85876]: WARNING amqp [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:59 devstack cinder-volume[85876]: WARNING amqp [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:59 devstack cinder-volume[85611]: INFO oslo_service.backend._eventlet.service [None req-3a2e0971-23cb-4a8a-a61a-af1bd7244deb None None] Child 85876 exited with status 0 Sep 23 00:10:00 devstack cinder-volume[86381]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:10:00 devstack cinder-volume[86381]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:00 devstack cinder-volume[86381]: we strongly recommend against using it for new projects. Sep 23 00:10:00 devstack cinder-volume[86381]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:00 devstack cinder-volume[86381]: framework. For more detail see Sep 23 00:10:00 devstack cinder-volume[86381]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:00 devstack cinder-volume[86381]: import eventlet # noqa Sep 23 00:10:05 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:05 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:05 devstack cinder-volume[86381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86381) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:06 devstack cinder-volume[86381]: INFO dbcounter [None req-01212929-6738-4673-a11a-d580994f4717 None None] Registered counter for database cinder Sep 23 00:10:06 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-01212929-6738-4673-a11a-d580994f4717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG dbcounter [-] [86381] Writer thread running {{(pid=86381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:07 devstack cinder-volume[86381]: INFO cinder.rpc [None req-01212929-6738-4673-a11a-d580994f4717 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:10:07 devstack cinder-volume[86381]: INFO cinder.rpc [None req-01212929-6738-4673-a11a-d580994f4717 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-01212929-6738-4673-a11a-d580994f4717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:07 devstack cinder-volume[86381]: INFO cinder.volume.manager [None req-01212929-6738-4673-a11a-d580994f4717 None None] Determined volume DB was empty at startup. Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG cinder.volume.manager [None req-01212929-6738-4673-a11a-d580994f4717 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86381) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:10:07 devstack cinder-volume[86381]: WARNING stevedore.named [None req-01212929-6738-4673-a11a-d580994f4717 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:10:07 devstack cinder-volume[86381]: WARNING castellan.key_manager [None req-01212929-6738-4673-a11a-d580994f4717 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:07 devstack cinder-volume[86381]: WARNING cinder.keymgr.conf_key_mgr [None req-01212929-6738-4673-a11a-d580994f4717 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:07 devstack cinder-volume[86381]: INFO cinder.volume.manager [None req-01212929-6738-4673-a11a-d580994f4717 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_db.sqlalchemy.engines [None req-01212929-6738-4673-a11a-d580994f4717 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86381) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:07 devstack cinder-volume[86381]: INFO oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] Starting 1 workers Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] Started child 87132 {{(pid=86381) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] Full set of CONF: {{(pid=86381) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] ******************************************************************************** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] Configuration options gathered from: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] ================================================================================ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] allow_availability_zone_fallback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] allow_compression_on_image_upload = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] allowed_direct_url_schemes = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] api_rate_limit = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] auth_strategy = keystone {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[87132]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_stats_polling_interval = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backup_api_class = cinder.backup.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backup_name_template = backup-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backup_use_same_host = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backup_use_temp_snapshot = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] chap_username = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_internal_tenant_project_id = 5564adfdc4d24e96814d35e8813c8b23 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_internal_tenant_user_id = d285b0992df1412ab6098503787a1e5e {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cluster = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] compression_format = gzip {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] compute_api_class = cinder.compute.nova.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] config_dir = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] config_source = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] control_exchange = openstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] debug = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] default_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] default_group_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] default_volume_type = QuobyteHD {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] deployment_max_gigabytes = -1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_ssl_cert_verify = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] driver_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] enable_new_services = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] enable_unsupported_driver = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] enabled_backends = ['QuobyteHD'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] enforce_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_api_insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_api_servers = ['http://192.168.122.137/image'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_api_ssl_compression = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_ca_certificates_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_catalog_info = image:glance:publicURL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_num_retries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance_request_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] graceful_shutdown_timeout = 5 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] group_api_class = cinder.group.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] host = devstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_compress_on_upload = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_conversion_address_space_limit = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_conversion_cpu_limit = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_conversion_disable = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_introspection_address_space_limit = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_introspection_cpu_limit = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_upload_use_cinder_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_upload_use_internal_tenant = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_volume_cache_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_volume_cache_max_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] image_volume_cache_max_size_gb = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] init_host_max_objects_retrieval = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] instance_format = [instance: %(uuid)s] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iscsi_target_flags = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iscsi_write_cache = on {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iser_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iser_ip_address = 192.168.122.137 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iser_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_color = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_config_append = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_options = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_rotate_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_rotate_interval_type = days {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] log_rotation_type = none {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] max_age = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] max_logfile_count = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] max_logfile_size_mb = 200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] max_over_subscription_ratio = 20.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] message_reap_interval = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] message_ttl = 2592000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] migration_create_volume_timeout_secs = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] monkey_patch = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] monkey_patch_modules = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] my_ip = 192.168.122.137 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] no_snapshot_gb_quota = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] num_iser_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] num_shell_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] num_volume_device_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] nvmeof_conn_info_version = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] nvmet_ns_id = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] nvmet_port_id = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_max_limit = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_ext_list = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_listen_port = 8776 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] osapi_volume_workers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] per_volume_size_limit = -1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] periodic_fuzzy_delay = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] periodic_interval = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] public_endpoint = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] publish_errors = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_backup_gigabytes = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_backups = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_gigabytes = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_groups = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_snapshots = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] quota_volumes = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] rate_limit_burst = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] rate_limit_except_level = CRITICAL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] rate_limit_interval = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] reinit_driver_count = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] report_discard_supported = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] report_interval = 120 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] reservation_clean_interval = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] reservation_expire = 86400 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] reserved_image_namespaces = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] reserved_percentage = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] rpc_response_timeout = 120 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] run_external_periodic_tasks = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] scst_target_driver = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_down_time = 720 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] shell_completion = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] snapshot_name_template = snapshot-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] state_path = /opt/stack/data/cinder {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] storage_availability_zone = nova {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] storage_protocol = iSCSI {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] syslog_log_facility = LOG_USER {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_helper = lioadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_ip_address = 192.168.122.137 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_protocol = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] target_secondary_ip_addresses = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] transport_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] until_refresh = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_chap_auth = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_default_quota_class = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87132) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_journal = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_json = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_stderr = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] use_syslog = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] verify_glance_signatures = enabled {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_api_class = cinder.volume.api.API {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_clear = zero {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_clear_size = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_copy_bps_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_dd_blocksize = 1M {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_name_template = volume-%s {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_service_inithost_offload = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volume_usage_audit_period = month {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] zoning_mode = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_concurrency.disable_process_locking = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.auth_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.include_service_catalog = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.interface = public {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcache_username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.service_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.137/identity {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.backend = dogpile.cache.null {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.backend_argument = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.backend_expiration_time = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.config_prefix = cache.oslo {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.debug_cache_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.enable_retry_client = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.enable_socket_keepalive = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.expiration_time = 600 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.hashclient_retry_attempts = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_dead_retry = 300 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_pool_maxsize = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_sasl_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.proxies = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.redis_db = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.redis_server = localhost:6379 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.retry_attempts = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.retry_delay = 0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.socket_keepalive_count = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.socket_keepalive_idle = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.socket_keepalive_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.socket_timeout = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.tls_allowed_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.tls_cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.tls_certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.tls_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.tls_keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cache.username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] coordination.backend_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.asyncio_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.asyncio_slave_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.backend = sqlalchemy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.connection_debug = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.connection_parameters = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.connection_recycle_time = 3600 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.connection_trace = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.db_inc_retry_interval = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.db_max_retries = 20 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.db_max_retry_interval = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.db_retry_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.max_overflow = 50 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.max_pool_size = 5 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.max_retries = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.mysql_wsrep_sync_wait = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.pool_timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.retry_interval = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.slave_connection = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.sqlite_synchronous = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.synchronous_reader = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] database.use_db_reconnect = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_tracing.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.connection_string = messaging:// {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.es_doc_type = notification {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.es_scroll_size = 10000 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.es_scroll_time = 2m {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.filter_error_trace = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.hmac_keys = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.sentinel_service_name = mymaster {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.socket_timeout = 0.1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.trace_requests = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler.trace_sqlalchemy = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler_jaeger.process_tags = {} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler_jaeger.service_name_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] profiler_otlp.service_name_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.enforce_new_defaults = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.policy_default_rule = default {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.policy_file = policy.yaml {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.group = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.helper_command = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] privsep_osbrick.user = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.group = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.helper_command = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] cinder_sys_admin.user = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.send_service_user_token = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] service_user.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.auth_type = password {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] glance.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.chap_username = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.driver_use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.extra_capabilities = {} {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iscsi_target_flags = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iscsi_write_cache = on {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iser_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iser_ip_address = 192.168.122.137 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iser_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_host = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_login = admin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87132) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:10:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_mount_options = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_private_key = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_share_path = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.num_shell_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Running cmd (subprocess): mount.quobyte {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.quobyte_volume_url = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.report_discard_supported = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.reserved_percentage = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_helper = tgtadm {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_ip_address = 192.168.122.137 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_port = 3260 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_protocol = iscsi {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.unique_fqdn_network = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.use_chap_auth = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_backend_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_clear = zero {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_clear_size = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_reports.file_event_handler = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_reports.log_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.backend_availability_zone = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.backend_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.chap_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.chap_username = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.chiscsi_conf = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.disk_geometry = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_client_cert = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_data_namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.driver_use_ssl = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.extra_capabilities = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.filter_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.goodness_function = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iser_helper = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iser_ip_address = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iser_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.iser_target_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_host = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_login = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_mount_options = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_password = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_private_key = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_share_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_ssh_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.num_shell_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.nvmet_port_id = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.replication_device = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.report_discard_supported = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.reserved_percentage = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.scst_target_driver = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.storage_protocol = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_helper = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_ip_address = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_port = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_prefix = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_protocol = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.trace_flags = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.use_chap_auth = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_clear = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_clear_size = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] QuobyteHD.volumes_dir = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_notifications.driver = [] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_notifications.retry = -1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] key_manager.fixed_key = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.barbican_api_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.barbican_endpoint = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.barbican_endpoint_type = public {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.barbican_region_name = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.number_of_retries = 60 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.retry_delay = 1 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.send_service_user_token = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.verify_ssl = True {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican.verify_ssl_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.auth_section = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.auth_type = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.cafile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.certfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.collect_timing = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.insecure = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.keyfile = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.split_loggers = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.timeout = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.tls_ciphers = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] barbican_service_user.tls_min_version = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.approle_role_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.approle_secret_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.auth_method = approle {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.auth_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.kv_mountpoint = secret {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.kv_path = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.kv_version = 2 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.namespace = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.root_token_id = **** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.ssl_ca_crt_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.timeout = 60.0 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.token_file = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.token_role = None {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.use_ssl = False {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:07 devstack cinder-volume[86381]: DEBUG oslo_service.backend._eventlet.service [None req-01212929-6738-4673-a11a-d580994f4717 None None] ******************************************************************************** {{(pid=86381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:10:07 devstack quobyte-client[87136]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:10:07 devstack quobyte-client[87136]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:07 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:10:07 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:07 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:07 devstack cinder-volume[87132]: INFO cinder.volume.driver [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:10:07 devstack cinder-volume[87132]: DEBUG cinder.volume.driver [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_db.sqlalchemy.engines [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87132) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writer thread running {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.db.api [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Building query based on filter {{(pid=87132) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3973}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87132) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.keymgr.migration [None req-0ba6f4ee-10de-4cc3-bf36-df58953c1fb6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:10:08 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:10:08 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:08 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Driver initialization completed successfully. Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Initiating service 3 cleanup Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Service 3 cleanup completed. Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.service [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Creating RPC server for service cinder-volume {{(pid=87132) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.service [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87132) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:08 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:10:08 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:08 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6415db75-187c-4063-8a6a-fb5d13c668fe None None] Driver post RPC initialization completed successfully. Sep 23 00:10:17 devstack cinder-volume[86381]: DEBUG dbcounter [-] [86381] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 6 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Flow 'volume_create_manager' (67bb7cb1-ed24-4e6a-8114-c4e03a23e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89990cfb-eeaa-47e0-94d3-6c1c2c54722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89990cfb-eeaa-47e0-94d3-6c1c2c54722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771042153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46baecb7-52e0-443d-978e-bceff3a3fd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe3c3d54ea4001aadaceca12b9b81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:04Z,use_quota=True,user_id='b92d7c9c0e8f4348b97bad6460d9651f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27558c04-4188-4474-be73-68a396318311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27558c04-4188-4474-be73-68a396318311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c13fcc2-0723-4559-bc8e-2c1eee402560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c13fcc2-0723-4559-bc8e-2c1eee402560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46baecb7-52e0-443d-978e-bceff3a3fd60', 'volume_name': 'volume-46baecb7-52e0-443d-978e-bceff3a3fd60', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab00e7b-741f-49aa-872b-ae9ad8668338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab00e7b-741f-49aa-872b-ae9ad8668338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a406a315-9246-4429-bcd4-dbbbc18023b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Volume 46baecb7-52e0-443d-978e-bceff3a3fd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46baecb7-52e0-443d-978e-bceff3a3fd60', 'volume_size': 1} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771042153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46baecb7-52e0-443d-978e-bceff3a3fd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe3c3d54ea4001aadaceca12b9b81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:04Z,use_quota=True,user_id='b92d7c9c0e8f4348b97bad6460d9651f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Creating volume 46baecb7-52e0-443d-978e-bceff3a3fd60 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:04 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 1073741824 Sep 23 00:11:04 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Flow 'volume_create_manager' (192d4d6d-4a4c-4b04-899e-2691dfbb3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d6336a-c654-4cc6-8b1b-ba8c2f747625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d6336a-c654-4cc6-8b1b-ba8c2f747625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1114946645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca33509-59c4-41d4-b8f0-488368ea3956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9683c47ce3a48089ca9536ff5ebbb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:04Z,use_quota=True,user_id='3b19b1732d4a4f1da86c7d3dba1fd341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecef86d1-4670-494c-b8b6-464e51132238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecef86d1-4670-494c-b8b6-464e51132238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4427d24d-6f53-4ee4-9970-f3353ea15fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4427d24d-6f53-4ee4-9970-f3353ea15fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca33509-59c4-41d4-b8f0-488368ea3956', 'volume_name': 'volume-6ca33509-59c4-41d4-b8f0-488368ea3956', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed23be4-b38b-4fa0-b3ec-68f7a259927a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed23be4-b38b-4fa0-b3ec-68f7a259927a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815d2445-5d7d-49ed-8788-0a8cbe005c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Volume 6ca33509-59c4-41d4-b8f0-488368ea3956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca33509-59c4-41d4-b8f0-488368ea3956', 'volume_size': 1} Sep 23 00:11:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:05 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 1073741824" returned: 0 in 0.843s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:05 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 Sep 23 00:11:05 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:05 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1114946645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca33509-59c4-41d4-b8f0-488368ea3956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9683c47ce3a48089ca9536ff5ebbb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:04Z,use_quota=True,user_id='3b19b1732d4a4f1da86c7d3dba1fd341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Creating volume 6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a406a315-9246-4429-bcd4-dbbbc18023b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46baecb7-52e0-443d-978e-bceff3a3fd60', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f02e9c-79e4-42dd-9b5e-5da7fbbf84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:05 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 1073741824 Sep 23 00:11:05 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Volume volume-46baecb7-52e0-443d-978e-bceff3a3fd60 (46baecb7-52e0-443d-978e-bceff3a3fd60): created successfully Sep 23 00:11:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f02e9c-79e4-42dd-9b5e-5da7fbbf84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Flow 'volume_create_manager' (67bb7cb1-ed24-4e6a-8114-c4e03a23e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6e5fb669-c75e-474d-9af0-553cb1b4c36f tempest-TaggedAttachmentsTest-234613693 None] Created volume successfully. Sep 23 00:11:06 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 1073741824" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:06 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 Sep 23 00:11:06 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:06 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815d2445-5d7d-49ed-8788-0a8cbe005c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca33509-59c4-41d4-b8f0-488368ea3956', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb8b657-22df-4dda-8815-f970d78c164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Volume volume-6ca33509-59c4-41d4-b8f0-488368ea3956 (6ca33509-59c4-41d4-b8f0-488368ea3956): created successfully Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb8b657-22df-4dda-8815-f970d78c164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Flow 'volume_create_manager' (192d4d6d-4a4c-4b04-899e-2691dfbb3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b38b4545-8971-4476-b2a2-d35378ce26ea req-3f6ce021-f42d-44a8-9df8-b32a33777778 tempest-VolumesSnapshotsTestJSON-1509248572 None] Created volume successfully. Sep 23 00:11:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Creating offline snapshot 6fd2a58d-860f-484c-a12f-e576b7aca0e8 of volume 6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:11:08 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiprc7f8u/privsep.sock'] Sep 23 00:11:08 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiprc7f8u/privsep.sock Sep 23 00:11:08 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:11:09 devstack cinder-volume[87132]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:11:10 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:10 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Spawned new privsep daemon via rootwrap Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Accepted privsep connection to /tmp/tmpiprc7f8u/privsep.sock {{(pid=87132) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:11:10 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:11:10 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:11:10 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:11:10 devstack cinder-volume[87132]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87751 Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe38085-66e7-4544-954c-0bfecf977306]: (2,) {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c659c15-91d4-45fc-91e0-f65116dab3de]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:10 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 Sep 23 00:11:10 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:10 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:10 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 1G Sep 23 00:11:10 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:11 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 1G" returned: 0 in 0.727s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca33509-59c4-41d4-b8f0-488368ea3956 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:11 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca33509-59c4-41d4-b8f0-488368ea3956 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 Sep 23 00:11:11 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:11 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca33509-59c4-41d4-b8f0-488368ea3956 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:11 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 is being set with open permissions: ugo+rw Sep 23 00:11:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:11 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 Sep 23 00:11:11 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:12 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:12 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info Sep 23 00:11:12 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:13 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info is being set with open permissions: ugo+rw Sep 23 00:11:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:13 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info Sep 23 00:11:13 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:13 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.info" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c03d7016-7dff-4e52-baff-93062e1d5c64 req-a57b8c2b-8630-4935-b489-79ebdd5eb15b tempest-VolumesSnapshotsTestJSON-1509248572 None] Create snapshot completed successfully Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "cinder-6fd2a58d-860f-484c-a12f-e576b7aca0e8-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-6fd2a58d-860f-484c-a12f-e576b7aca0e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "cinder-quobyte-6fd2a58d-860f-484c-a12f-e576b7aca0e8" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6fd2a58d-860f-484c-a12f-e576b7aca0e8" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Deleting offline snapshot 6fd2a58d-860f-484c-a12f-e576b7aca0e8 of volume 6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] snapshot_file for this snap is: volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e66feb-24d2-40f5-8e89-ca8f6e3acbd5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:15 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 Sep 23 00:11:15 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:16 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca33509-59c4-41d4-b8f0-488368ea3956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c368673-7a50-4765-8d26-c49f7a6d3391]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:16 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 Sep 23 00:11:16 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:16 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:16 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 Sep 23 00:11:16 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:17 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:17 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8 Sep 23 00:11:17 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:17 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956.6fd2a58d-860f-484c-a12f-e576b7aca0e8" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6fd2a58d-860f-484c-a12f-e576b7aca0e8" released by "_delete_snapshot" :: held 2.235s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" released by "delete_snapshot" :: held 2.287s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:18 devstack cinder-volume[87132]: WARNING cinder.quota [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:18 devstack cinder-volume[87132]: WARNING cinder.quota [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.quota [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Created reservations ['c2387786-fd8d-4b20-b41b-e35afd2a5fa4', '80e8c9bc-03c6-440a-8218-59242c4ec354', '24d207ee-00e0-4db8-8069-64f74c3454f0', '0468b823-935e-442d-a7bd-8fdb7937539b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Delete snapshot completed successfully. Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-fbec2232-db98-4e07-a3dd-d918b84512c5 req-51072a8e-ac97-406a-909a-437020566de5 tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-6fd2a58d-860f-484c-a12f-e576b7aca0e8-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "cinder-6ca33509-59c4-41d4-b8f0-488368ea3956-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-6ca33509-59c4-41d4-b8f0-488368ea3956-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e9d097-58c1-4713-b4d5-b3f6e23de579]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:18 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 Sep 23 00:11:18 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:19 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:19 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956 Sep 23 00:11:19 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:19 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6ca33509-59c4-41d4-b8f0-488368ea3956" returned: 0 in 0.632s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-quobyte-6ca33509-59c4-41d4-b8f0-488368ea3956" released by "delete_volume" :: held 1.327s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:20 devstack cinder-volume[87132]: WARNING cinder.quota [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG cinder.quota [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Created reservations ['f67c9d7d-56ea-4eeb-8c68-d3473708f7f3', '85166012-474e-42f7-b67d-8acc2eb9d34c', '1afce5ce-264f-4186-803d-08917aede694', '64cd5897-6c30-4ddc-aed2-f90012f4066d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:20 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:11:20 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:20 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.642s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:20 devstack cinder-volume[87132]: DEBUG cinder.manager [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Deleted volume successfully. Sep 23 00:11:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-59ba7206-31ec-434f-b5a2-0901baf31054 req-6ab2e307-9c5c-4b1e-b43e-345bdb3ff63e tempest-VolumesSnapshotsTestJSON-1509248572 None] Lock "cinder-6ca33509-59c4-41d4-b8f0-488368ea3956-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Flow 'volume_create_manager' (b752e714-d35f-403e-9761-817094ca792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d3d852-bbae-42c7-9af8-cecfcca605c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d3d852-bbae-42c7-9af8-cecfcca605c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-371422063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddacde8-0869-4788-a541-e503769ecca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc3362eb6749e1ba8c84af2037e515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:29Z,use_quota=True,user_id='579fae0a2455463397057181909a123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fef345-396a-4d89-b256-12654c2e848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fef345-396a-4d89-b256-12654c2e848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d99d8-79c3-42f4-99ee-7fd1573a51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d99d8-79c3-42f4-99ee-7fd1573a51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddacde8-0869-4788-a541-e503769ecca8', 'volume_name': 'volume-2ddacde8-0869-4788-a541-e503769ecca8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a92f83-5730-4292-89bb-1f25d74e2eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a92f83-5730-4292-89bb-1f25d74e2eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e8c2c6-a6d0-42c1-90cb-bf3eea4cf16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Volume 2ddacde8-0869-4788-a541-e503769ecca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddacde8-0869-4788-a541-e503769ecca8', 'volume_size': 1} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-371422063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddacde8-0869-4788-a541-e503769ecca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc3362eb6749e1ba8c84af2037e515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:29Z,use_quota=True,user_id='579fae0a2455463397057181909a123b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Creating volume 2ddacde8-0869-4788-a541-e503769ecca8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:11:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:29 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 1073741824 Sep 23 00:11:29 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:30 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 1073741824" returned: 0 in 1.116s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:30 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 Sep 23 00:11:30 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:31 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8" returned: 0 in 0.764s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e8c2c6-a6d0-42c1-90cb-bf3eea4cf16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddacde8-0869-4788-a541-e503769ecca8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e2eb7-3aef-4212-be26-552e54f2098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Volume volume-2ddacde8-0869-4788-a541-e503769ecca8 (2ddacde8-0869-4788-a541-e503769ecca8): created successfully Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7e2eb7-3aef-4212-be26-552e54f2098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Flow 'volume_create_manager' (b752e714-d35f-403e-9761-817094ca792b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b4801a50-ab9f-4042-8c8f-a8a2a8ead066 tempest-VolumesAdminNegativeTest-56914346 None] Created volume successfully. Sep 23 00:11:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Acquiring lock "cinder-2ddacde8-0869-4788-a541-e503769ecca8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "cinder-2ddacde8-0869-4788-a541-e503769ecca8-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Acquiring lock "cinder-quobyte-2ddacde8-0869-4788-a541-e503769ecca8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "cinder-quobyte-2ddacde8-0869-4788-a541-e503769ecca8" acquired by "delete_volume" :: waited 0.066s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8055a0-1753-493f-b7d8-5d4ae72d75c5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:35 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 Sep 23 00:11:35 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3c176859-9dc8-4a12-b124-a9a1af236502 tempest-BackendsCapabilitiesAdminTestsJSON-545422813 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:11:36 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8" returned: 0 in 1.123s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-407db67b-295e-4dd4-aec3-b035cc55c5c2 tempest-BackendsCapabilitiesAdminTestsJSON-545422813 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:11:36 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8 Sep 23 00:11:36 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:36 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2ddacde8-0869-4788-a541-e503769ecca8" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "cinder-quobyte-2ddacde8-0869-4788-a541-e503769ecca8" released by "delete_volume" :: held 1.975s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Created reservations ['1365f0e5-ec86-44b5-bef3-b884834ab5db', '49f31e2b-064f-4ef7-b5d5-ee822afa9d5f', 'e580be0f-ae8a-4b3c-8e8f-e1f152cfa9cf', '5b5c3b93-514f-4b0e-904d-cd8e29a0cae0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:37 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:11:37 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:38 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.746s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Deleted volume successfully. Sep 23 00:11:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bd003fbb-fadd-45e3-9c3b-2abf088936b1 tempest-VolumesAdminNegativeTest-56914346 None] Lock "cinder-2ddacde8-0869-4788-a541-e503769ecca8-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=40,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:48 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=32,cinder:UPDATE=24,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:49 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:11:49 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:50 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:11:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d80292a8-ed7f-4b2d-8ff3-2795858d60f3 tempest-GroupsTest-146855404 None] Group tempest-Group1-766446874: creating Sep 23 00:11:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d80292a8-ed7f-4b2d-8ff3-2795858d60f3 tempest-GroupsTest-146855404 None] Group tempest-Group1-766446874: created successfully Sep 23 00:11:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d80292a8-ed7f-4b2d-8ff3-2795858d60f3 tempest-GroupsTest-146855404 None] Create group completed successfully. Sep 23 00:11:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-042afaac-1813-4567-a4c3-5702718d32eb tempest-GroupsTest-146855404 None] Group tempest-Group2-2095485082: creating Sep 23 00:11:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-042afaac-1813-4567-a4c3-5702718d32eb tempest-GroupsTest-146855404 None] Group tempest-Group2-2095485082: created successfully Sep 23 00:11:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-042afaac-1813-4567-a4c3-5702718d32eb tempest-GroupsTest-146855404 None] Create group completed successfully. Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (2b8425cf-1886-4e9e-94f8-492217d09317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d8164d-7bc1-4b1e-8c39-581cfa60d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d8164d-7bc1-4b1e-8c39-581cfa60d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472301391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e4e8eaa-db20-4791-9344-4cbf052c519f,host='devstack@QuobyteHD#QuobyteHD',id=3c267347-31f2-43ed-bfa9-660fac1a4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:55Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(267ed16a-50a2-4bdd-aacc-c8c14750da23),volume_type_id=267ed16a-50a2-4bdd-aacc-c8c14750da23)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dadda8-3627-44b8-875a-1dd987db4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dadda8-3627-44b8-875a-1dd987db4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ed3282-8287-4ff0-bafb-4f4f92d150c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ed3282-8287-4ff0-bafb-4f4f92d150c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c267347-31f2-43ed-bfa9-660fac1a4df3', 'volume_name': 'volume-3c267347-31f2-43ed-bfa9-660fac1a4df3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e675182-d7e4-4485-b42e-e011aad464a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e675182-d7e4-4485-b42e-e011aad464a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f0a24b-852e-4287-b124-9d9a5854c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Volume 3c267347-31f2-43ed-bfa9-660fac1a4df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c267347-31f2-43ed-bfa9-660fac1a4df3', 'volume_size': 1} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e4e8eaa-db20-4791-9344-4cbf052c519f,created_at=2026-09-22T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1472301391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e4e8eaa-db20-4791-9344-4cbf052c519f,host='devstack@QuobyteHD#QuobyteHD',id=3c267347-31f2-43ed-bfa9-660fac1a4df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:55Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(267ed16a-50a2-4bdd-aacc-c8c14750da23),volume_type_id=267ed16a-50a2-4bdd-aacc-c8c14750da23)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Creating volume 3c267347-31f2-43ed-bfa9-660fac1a4df3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:11:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:55 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 1073741824 Sep 23 00:11:55 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:56 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 1073741824" returned: 0 in 0.664s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:56 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 Sep 23 00:11:56 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:56 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3" returned: 0 in 0.348s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f0a24b-852e-4287-b124-9d9a5854c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c267347-31f2-43ed-bfa9-660fac1a4df3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb5f9bd-af1d-4468-85f7-0da05b8f0ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Volume volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 (3c267347-31f2-43ed-bfa9-660fac1a4df3): created successfully Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb5f9bd-af1d-4468-85f7-0da05b8f0ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (2b8425cf-1886-4e9e-94f8-492217d09317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b0c7bf2-6c6d-4bab-b5db-8e3cba25f558 tempest-GroupsTest-146855404 None] Created volume successfully. Sep 23 00:11:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Acquiring lock "cinder-quobyte-3c267347-31f2-43ed-bfa9-660fac1a4df3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-3c267347-31f2-43ed-bfa9-660fac1a4df3" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430e4b9-84d5-4462-90ee-12657eb60989]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:58 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 Sep 23 00:11:58 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:59 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:59 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3 Sep 23 00:11:59 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:59 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3c267347-31f2-43ed-bfa9-660fac1a4df3" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-3c267347-31f2-43ed-bfa9-660fac1a4df3" released by "delete_volume" :: held 0.935s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Created reservations ['0c57e9cb-7045-4053-8855-012dc95e1724'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:59 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1755717484 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1755717484, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:59 devstack cinder-volume[87132]: WARNING cinder.quota [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1755717484 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1755717484, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Created reservations ['e9d96105-94e9-441c-b0d2-4beaa0f664db', 'b7718f4d-048c-4885-8094-1e1943a640f3', 'bd51c2be-e8d4-4e89-ba1e-2b320d2e1476', '840c5688-a39f-4061-b24a-ea3bb68dc0b0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:00 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:12:00 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:00 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c107aded-a76f-4890-b6cb-6e2b1f6da2f3 tempest-GroupsTest-146855404 None] Delete group completed successfully. Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Created reservations ['c5899ac3-eb2d-4e07-9db4-50deccc204a5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:01 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:12:01 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:01 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0ae97366-09fd-4152-ad16-ae03f33c0dbe tempest-GroupsTest-146855404 None] Delete group completed successfully. Sep 23 00:12:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2ce2c54-302e-4776-a17d-8261cfb59f28 tempest-GroupsTest-146855404 None] Group tempest-GroupsTest-Group-63792534: creating Sep 23 00:12:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2ce2c54-302e-4776-a17d-8261cfb59f28 tempest-GroupsTest-146855404 None] Group tempest-GroupsTest-Group-63792534: created successfully Sep 23 00:12:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2ce2c54-302e-4776-a17d-8261cfb59f28 tempest-GroupsTest-146855404 None] Create group completed successfully. Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (19376360-2414-4a62-997c-114f12d5f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a16bdb-6803-4437-a741-1dba2462369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a16bdb-6803-4437-a741-1dba2462369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73622729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,host='devstack@QuobyteHD#QuobyteHD',id=23dd1ffd-4897-4a54-90ae-05c3ccc6fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:05Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25b1320-a5ff-4eff-878e-eadce2072502),volume_type_id=b25b1320-a5ff-4eff-878e-eadce2072502)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043761ce-f0e3-4ff8-a717-ea8758b9c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043761ce-f0e3-4ff8-a717-ea8758b9c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1c17c7-cde3-4330-8d95-add25fa9ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1c17c7-cde3-4330-8d95-add25fa9ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dd1ffd-4897-4a54-90ae-05c3ccc6fffa', 'volume_name': 'volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450a1616-11bf-4d0c-a963-86484500e0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450a1616-11bf-4d0c-a963-86484500e0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffca2d2-ab1b-4385-b376-aa9e2da1413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Volume 23dd1ffd-4897-4a54-90ae-05c3ccc6fffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa', 'volume_size': 1} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,created_at=2026-09-22T22:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73622729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,host='devstack@QuobyteHD#QuobyteHD',id=23dd1ffd-4897-4a54-90ae-05c3ccc6fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:05Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25b1320-a5ff-4eff-878e-eadce2072502),volume_type_id=b25b1320-a5ff-4eff-878e-eadce2072502)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Creating volume 23dd1ffd-4897-4a54-90ae-05c3ccc6fffa {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:05 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa 1073741824 Sep 23 00:12:05 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:05 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa 1073741824" returned: 0 in 0.714s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:06 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa Sep 23 00:12:06 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:06 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffca2d2-ab1b-4385-b376-aa9e2da1413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7533db-69bf-433d-936d-ccf7a20861f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Volume volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa (23dd1ffd-4897-4a54-90ae-05c3ccc6fffa): created successfully Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7533db-69bf-433d-936d-ccf7a20861f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (19376360-2414-4a62-997c-114f12d5f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a82b5bb1-334f-4235-9ed6-b584318eccad tempest-GroupsTest-146855404 None] Created volume successfully. Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (3812947a-98db-4d5a-9511-ed87bf72a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995bc485-2c43-4bf1-8daa-e2f856a35055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995bc485-2c43-4bf1-8daa-e2f856a35055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1205565581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,host='devstack@QuobyteHD#QuobyteHD',id=0ea872d1-1c18-4c8f-ab8c-f291c20d0d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:08Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25b1320-a5ff-4eff-878e-eadce2072502),volume_type_id=b25b1320-a5ff-4eff-878e-eadce2072502)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea248745-d8a0-46fe-a5f1-9ab09ad2fdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea248745-d8a0-46fe-a5f1-9ab09ad2fdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786b7496-8966-4598-9b85-c8bdb0a86016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786b7496-8966-4598-9b85-c8bdb0a86016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea872d1-1c18-4c8f-ab8c-f291c20d0d84', 'volume_name': 'volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac15b93-60b2-4e11-8dd6-a6aff14f0619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac15b93-60b2-4e11-8dd6-a6aff14f0619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64ee66b-154e-49ed-96bd-4500ff16b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Volume 0ea872d1-1c18-4c8f-ab8c-f291c20d0d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84', 'volume_size': 1} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,created_at=2026-09-22T22:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1205565581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f483341-0b3a-44dc-b17a-a2ce19d362c0,host='devstack@QuobyteHD#QuobyteHD',id=0ea872d1-1c18-4c8f-ab8c-f291c20d0d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4efbd1cdbe64f3baa4d6617599fa648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:08Z,use_quota=True,user_id='74455a449f5446ffb2cbcb1aa50d9463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b25b1320-a5ff-4eff-878e-eadce2072502),volume_type_id=b25b1320-a5ff-4eff-878e-eadce2072502)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Creating volume 0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:12:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:08 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 1073741824 Sep 23 00:12:08 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:09 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 1073741824" returned: 0 in 0.743s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:09 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 Sep 23 00:12:09 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:09 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64ee66b-154e-49ed-96bd-4500ff16b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe0ac6-f4ba-4af6-a58b-c32b7b86f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Volume volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 (0ea872d1-1c18-4c8f-ab8c-f291c20d0d84): created successfully Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe0ac6-f4ba-4af6-a58b-c32b7b86f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Flow 'volume_create_manager' (3812947a-98db-4d5a-9511-ed87bf72a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5f07476e-d4df-426e-a612-fc95c4527fb6 tempest-GroupsTest-146855404 None] Created volume successfully. Sep 23 00:12:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2222af87-a0c2-4445-87e0-00019a589736 tempest-GroupsTest-146855404 None] Update group completed successfully. Sep 23 00:12:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5082a57e-3365-44f3-9544-1eff2eae4fe9 tempest-GroupsTest-146855404 None] Update group completed successfully. Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Acquiring lock "cinder-quobyte-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3bbde1-c8a1-4e99-9f7f-4ed1e420507d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:15 devstack cinder-volume[87132]: WARNING py.warnings [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] /opt/stack/cinder/cinder/db/api.py:2499: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 23 00:12:15 devstack cinder-volume[87132]: .first() Sep 23 00:12:15 devstack cinder-volume[87132]: Sep 23 00:12:15 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 Sep 23 00:12:15 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-46baecb7-52e0-443d-978e-bceff3a3fd60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5cd21f0-f308-479c-860b-1bdfc2377e82', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:12:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-ebba4def-7852-427f-b191-75b77e5335a8 req-2fc6dd36-a104-4650-99ad-a422eb083ad3 tempest-TaggedAttachmentsTest-234613693 None] attachment_update completed successfully. Sep 23 00:12:16 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" returned: 0 in 0.602s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:16 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84 Sep 23 00:12:16 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:16 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-0ea872d1-1c18-4c8f-ab8c-f291c20d0d84" released by "delete_volume" :: held 1.143s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Acquiring lock "cinder-quobyte-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01728a4-bfec-41e6-9711-d7c8f39e8670]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:16 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa Sep 23 00:12:16 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:17 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" returned: 0 in 0.770s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:17 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa Sep 23 00:12:17 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:18 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" returned: 0 in 0.669s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "cinder-quobyte-23dd1ffd-4897-4a54-90ae-05c3ccc6fffa" released by "delete_volume" :: held 1.541s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Created reservations ['dd770332-0665-4865-916f-ee92f4198dd4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-28541991 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-28541991, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:18 devstack cinder-volume[87132]: WARNING cinder.quota [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-28541991 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-28541991, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Created reservations ['1609a00b-e9ee-40dc-8f49-ce4ce099cd08', 'e52f8c11-206d-4af1-a040-f42ccbfbab7c', 'd425db28-45bb-4963-9a4c-fae0ced908fa', '69950091-bb6a-429f-ae73-31ce30ff6724'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Created reservations ['511fedc2-3f54-418d-bfab-fc528810b537', '65c6aa50-cdd4-4037-8502-8badf26decd2', '1f89aa91-00f6-4b7c-a016-04ecd2dd712c', '1fc8f21a-6622-4c82-89f4-b7e2aa23a01d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:18 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:12:18 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:19 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-068ed5d0-6f51-4a15-8f96-0d81e0381604 tempest-GroupsTest-146855404 None] Delete group completed successfully. Sep 23 00:12:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-6eefcda8-312c-408e-83a0-a59b0d88f3cd req-fc7942fe-947c-4396-9f98-7dcbc90e2249 tempest-TaggedAttachmentsTest-234613693 None] Terminate volume connection completed successfully. Sep 23 00:12:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-6eefcda8-312c-408e-83a0-a59b0d88f3cd req-fc7942fe-947c-4396-9f98-7dcbc90e2249 tempest-TaggedAttachmentsTest-234613693 None] Deleting attachment f5cd21f0-f308-479c-860b-1bdfc2377e82. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:12:28 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=57,cinder:SELECT=41,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:32 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=57,cinder:UPDATE=38,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f92fbc28-cf31-46ba-9567-469fb276e517 tempest-GroupsV314Test-425084166 None] Group tempest-GroupsV314Test-Group-1746023782: creating Sep 23 00:12:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f92fbc28-cf31-46ba-9567-469fb276e517 tempest-GroupsV314Test-425084166 None] Group tempest-GroupsV314Test-Group-1746023782: created successfully Sep 23 00:12:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f92fbc28-cf31-46ba-9567-469fb276e517 tempest-GroupsV314Test-425084166 None] Create group completed successfully. Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Flow 'volume_create_manager' (01eb189d-b174-4246-af76-9e2356290f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e2206b-9ae2-4977-9045-1dd18dbc3599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e2206b-9ae2-4977-9045-1dd18dbc3599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533507142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4695da94-89f5-4278-9a05-893765791e03,host='devstack@QuobyteHD#QuobyteHD',id=6207a875-5e8e-49b3-ba18-0ab4547d39f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff928a96b1854308a57388c504207d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='9cb517e5f8d64f959c214caaeac7b389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77974e87-244f-41e2-ae93-717fe7347754),volume_type_id=77974e87-244f-41e2-ae93-717fe7347754)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ddef1-ecd7-450b-a407-e98fad83063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ddef1-ecd7-450b-a407-e98fad83063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5292b450-5c4c-4e23-b120-14f84047fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5292b450-5c4c-4e23-b120-14f84047fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6207a875-5e8e-49b3-ba18-0ab4547d39f8', 'volume_name': 'volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d5ea0a-43e4-4758-a13e-c061d6eabb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d5ea0a-43e4-4758-a13e-c061d6eabb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1961adfc-09dd-4526-9329-150da38037d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Volume 6207a875-5e8e-49b3-ba18-0ab4547d39f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8', 'volume_size': 1} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4695da94-89f5-4278-9a05-893765791e03,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533507142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4695da94-89f5-4278-9a05-893765791e03,host='devstack@QuobyteHD#QuobyteHD',id=6207a875-5e8e-49b3-ba18-0ab4547d39f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff928a96b1854308a57388c504207d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='9cb517e5f8d64f959c214caaeac7b389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77974e87-244f-41e2-ae93-717fe7347754),volume_type_id=77974e87-244f-41e2-ae93-717fe7347754)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Creating volume 6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:12:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:37 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 1073741824 Sep 23 00:12:37 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:38 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 1073741824" returned: 0 in 0.926s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:38 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:12:38 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:39 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1961adfc-09dd-4526-9329-150da38037d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b84a63f-9509-46b8-ae3f-8db7877fa0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Volume volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 (6207a875-5e8e-49b3-ba18-0ab4547d39f8): created successfully Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b84a63f-9509-46b8-ae3f-8db7877fa0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Flow 'volume_create_manager' (01eb189d-b174-4246-af76-9e2356290f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c59c7177-cce1-4b47-b3ca-5bc5cd941f75 tempest-GroupsV314Test-425084166 None] Created volume successfully. Sep 23 00:12:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:41 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Cloning volume 6207a875-5e8e-49b3-ba18-0ab4547d39f8 to volume 04e57364-9ff2-4a1a-a607-01d57fb15f3f Sep 23 00:12:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Creating offline snapshot f9083689-7be1-41c9-b937-e2a5d0da85a4 of volume 6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:12:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[283dbf4f-2407-4514-92c5-b4d3ab3865c5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:41 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:12:41 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:42 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.925s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:42 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 1G Sep 23 00:12:42 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "cinder-46baecb7-52e0-443d-978e-bceff3a3fd60-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "cinder-46baecb7-52e0-443d-978e-bceff3a3fd60-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "cinder-quobyte-46baecb7-52e0-443d-978e-bceff3a3fd60" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "cinder-quobyte-46baecb7-52e0-443d-978e-bceff3a3fd60" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[70781c10-f5f0-4b52-9725-b6c103051b06]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:43 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 1G" returned: 0 in 1.662s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:12:44 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 Sep 23 00:12:44 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:12:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60" returned: 0 in 0.659s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:12:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60 Sep 23 00:12:44 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-46baecb7-52e0-443d-978e-bceff3a3fd60" returned: 0 in 0.571s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "cinder-quobyte-46baecb7-52e0-443d-978e-bceff3a3fd60" released by "delete_volume" :: held 1.419s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info Sep 23 00:12:45 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Created reservations ['8bb3953f-5c3a-432c-a6cb-f70723082241', '8b7fa271-0c1a-4169-b461-e82cd77ad07d', '5965a183-9f92-476d-83b0-71936de501d1', '7b7ae23c-ac40-47e6-a30e-68f8d5e8b4dd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:12:45 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info Sep 23 00:12:45 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Deleted volume successfully. Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-948dc574-50cf-46a1-9891-79f7b939e740 tempest-TaggedAttachmentsTest-234613693 None] Lock "cinder-46baecb7-52e0-443d-978e-bceff3a3fd60-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.info" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Acquiring lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] snapshot: f9083689-7be1-41c9-b937-e2a5d0da85a4, volume: 04e57364-9ff2-4a1a-a607-01d57fb15f3f, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[86867db8-5bef-4ff4-bc05-1c37320d543d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:46 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:12:46 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:46 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aef022-3426-41e0-9d58-5a1b6aa42c73]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:46 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:12:46 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:47 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.915s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:12:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:12:47 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:12:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:47 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f Sep 23 00:12:47 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Flow 'volume_create_manager' (a167ae07-eefc-45b0-a212-1e67b7999a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe8856-167b-4cfd-9560-06d2d5f1c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe8856-167b-4cfd-9560-06d2d5f1c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1949126387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e616ae21-6c88-440c-93db-a876fdfd48f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a821a67f0246ef801f40451c5807c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:48Z,use_quota=True,user_id='15646e31ab5b4e7fbb2b81e488eff35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdcd13d-a6ac-4bba-a9a0-9be4c453ffd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdcd13d-a6ac-4bba-a9a0-9be4c453ffd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af29bed3-1648-4208-86e9-ae3943484935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af29bed3-1648-4208-86e9-ae3943484935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e616ae21-6c88-440c-93db-a876fdfd48f3', 'volume_name': 'volume-e616ae21-6c88-440c-93db-a876fdfd48f3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4a7053-1979-4fba-acc8-ddce248e01ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4a7053-1979-4fba-acc8-ddce248e01ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38826a28-fe78-4e23-8ab1-f4cd41a31898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Volume e616ae21-6c88-440c-93db-a876fdfd48f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e616ae21-6c88-440c-93db-a876fdfd48f3', 'volume_size': 1} Sep 23 00:12:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:12:49 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 1.019s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:12:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:12:58 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:58 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=14,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:59 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f" returned: 0 in 11.566s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8, size 1024.00 MB, duration 11.57 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:12:59 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Converted 1024.00 MB image at 88.53 MB/s Sep 23 00:12:59 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:59 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f Sep 23 00:12:59 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:59 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" released by "_copy_volume_from_snapshot" :: held 13.424s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Acquiring lock "cinder-quobyte-f9083689-7be1-41c9-b937-e2a5d0da85a4" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-f9083689-7be1-41c9-b937-e2a5d0da85a4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Deleting offline snapshot f9083689-7be1-41c9-b937-e2a5d0da85a4 of volume 6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] snapshot_file for this snap is: volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d8a91f-04b3-433c-a83f-8aa8b31d66fb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:59 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:12:59 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Flow 'volume_create_manager' (464f4641-e679-47b6-b428-4dcef287f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99394570-8a88-4b25-9afe-433a783c6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99394570-8a88-4b25-9afe-433a783c6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-456643032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22c1563-e4a4-4a72-9c3f-2da3bca5696c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eeb9decf884b609654a3d2a1c24f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:00Z,use_quota=True,user_id='8ea3ef64dc3649cf8ff25bcee9e9532d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e05554-c64a-4602-a745-7aab0a3aa9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e05554-c64a-4602-a745-7aab0a3aa9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387de731-7002-4500-b40a-9de35daff491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387de731-7002-4500-b40a-9de35daff491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'volume_name': 'volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fd88dd-4f4f-4c0b-8b4e-a2a8344bf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fd88dd-4f4f-4c0b-8b4e-a2a8344bf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bc0734-5b36-45a7-aeec-ef74314e42ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Volume f22c1563-e4a4-4a72-9c3f-2da3bca5696c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'volume_size': 1} Sep 23 00:12:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:00 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e687f28-b44e-4df6-a99d-deed4ab25cf2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:00 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:13:00 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:00 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:00 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:13:00 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:01 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.684s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:01 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4 Sep 23 00:13:01 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:01 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8.f9083689-7be1-41c9-b937-e2a5d0da85a4" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-f9083689-7be1-41c9-b937-e2a5d0da85a4" released by "_delete_snapshot" :: held 2.627s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.816s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.805s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1949126387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e616ae21-6c88-440c-93db-a876fdfd48f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a821a67f0246ef801f40451c5807c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:48Z,use_quota=True,user_id='15646e31ab5b4e7fbb2b81e488eff35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Creating volume e616ae21-6c88-440c-93db-a876fdfd48f3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 1073741824 Sep 23 00:13:02 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c20ea74f-59cc-4e02-8ee2-4a9b8fa06bcf tempest-GroupsV314Test-425084166 None] Create group from source-group-4695da94-89f5-4278-9a05-893765791e03 completed successfully. Sep 23 00:13:02 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 1073741824" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 Sep 23 00:13:02 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:03 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.355s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-456643032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22c1563-e4a4-4a72-9c3f-2da3bca5696c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eeb9decf884b609654a3d2a1c24f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:00Z,use_quota=True,user_id='8ea3ef64dc3649cf8ff25bcee9e9532d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Creating volume f22c1563-e4a4-4a72-9c3f-2da3bca5696c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:03 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c 1073741824 Sep 23 00:13:03 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38826a28-fe78-4e23-8ab1-f4cd41a31898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e616ae21-6c88-440c-93db-a876fdfd48f3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de01f53-5400-41a9-88d5-18ebd708a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Volume volume-e616ae21-6c88-440c-93db-a876fdfd48f3 (e616ae21-6c88-440c-93db-a876fdfd48f3): created successfully Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de01f53-5400-41a9-88d5-18ebd708a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Flow 'volume_create_manager' (a167ae07-eefc-45b0-a212-1e67b7999a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f81c4911-2dfe-4836-8eba-2d5829b2a332 tempest-DeleteServersTestJSON-1449419127 None] Created volume successfully. Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Acquiring lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae90580-4440-408b-ab58-144b3e4e863e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:04 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f Sep 23 00:13:04 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:04 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c 1073741824" returned: 0 in 0.966s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:04 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c Sep 23 00:13:04 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:04 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29bc0734-5b36-45a7-aeec-ef74314e42ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:04 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f78fb6-265a-43e9-aa5a-2ea69802d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f" returned: 0 in 0.839s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Volume volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c (f22c1563-e4a4-4a72-9c3f-2da3bca5696c): created successfully Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f78fb6-265a-43e9-aa5a-2ea69802d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Flow 'volume_create_manager' (464f4641-e679-47b6-b428-4dcef287f28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:04 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f Sep 23 00:13:04 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e4039ea4-f408-420b-bec5-b0495b5f89d7 tempest-ServerActionsTestOtherA-1637709275 None] Created volume successfully. Sep 23 00:13:05 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-04e57364-9ff2-4a1a-a607-01d57fb15f3f" returned: 0 in 0.465s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-04e57364-9ff2-4a1a-a607-01d57fb15f3f" released by "delete_volume" :: held 1.391s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Created reservations ['8b7c7f7f-6365-483f-adbc-ef84b8a5ff74'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:05 devstack cinder-volume[87132]: WARNING cinder.quota [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1838615664 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1838615664, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:13:05 devstack cinder-volume[87132]: WARNING cinder.quota [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1838615664 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1838615664, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Created reservations ['74d1366a-9786-46aa-bcbb-91a3e337cea7', '78b56a6a-d702-4177-aff8-93ebd59aff5c', '16fd299e-e137-4fb4-beb9-ddba7f151813', '932fac62-b3ce-4606-b18a-a94c2702d74f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-cd0a0f34-06c8-4d1a-9b66-9badaa148704 req-572016d2-c7f8-40f4-a975-5e1f3fd95423 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-cd0a0f34-06c8-4d1a-9b66-9badaa148704 req-572016d2-c7f8-40f4-a975-5e1f3fd95423 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-cd0a0f34-06c8-4d1a-9b66-9badaa148704 req-572016d2-c7f8-40f4-a975-5e1f3fd95423 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-cd0a0f34-06c8-4d1a-9b66-9badaa148704 req-572016d2-c7f8-40f4-a975-5e1f3fd95423 tempest-DeleteServersTestJSON-1449419127 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-e616ae21-6c88-440c-93db-a876fdfd48f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94b063ce-223d-46fa-9f15-b01db50628bf', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-cd0a0f34-06c8-4d1a-9b66-9badaa148704 req-572016d2-c7f8-40f4-a975-5e1f3fd95423 tempest-DeleteServersTestJSON-1449419127 None] attachment_update completed successfully. Sep 23 00:13:05 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:13:05 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:06 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00b4e532-54e6-433b-a0ef-8ef5dbbee3b6 tempest-GroupsV314Test-425084166 None] Delete group completed successfully. Sep 23 00:13:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Acquiring lock "cinder-quobyte-6207a875-5e8e-49b3-ba18-0ab4547d39f8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-6207a875-5e8e-49b3-ba18-0ab4547d39f8" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e149d-8edc-4374-ae62-e9ef19fe0147]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:07 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:13:07 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:07 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.725s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:08 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8 Sep 23 00:13:08 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:08 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6207a875-5e8e-49b3-ba18-0ab4547d39f8" returned: 0 in 0.645s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Lock "cinder-quobyte-6207a875-5e8e-49b3-ba18-0ab4547d39f8" released by "delete_volume" :: held 1.661s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Created reservations ['25f0ab86-891f-4c8a-82b6-eb845e49199b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Created reservations ['0f5edeaf-7bdf-4807-a14a-fbcb6285b03d', 'e21a41af-dec6-4a7e-9870-d630cc7287f9', 'c22eb793-70c9-4f99-a1e2-b18dd1680982', 'cef14a8c-1f5d-4028-bfdc-1958ba277b36'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:09 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:13:09 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:10 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.670s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f24173e-14e6-40e5-a34f-b628d720dc21 tempest-GroupsV314Test-425084166 None] Delete group completed successfully. Sep 23 00:13:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4df82e86-8e28-43bb-89c7-87389196b2b7 req-bda0389a-89c0-4411-a053-13706b0ace79 tempest-DeleteServersTestJSON-1449419127 None] Terminate volume connection completed successfully. Sep 23 00:13:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4df82e86-8e28-43bb-89c7-87389196b2b7 req-bda0389a-89c0-4411-a053-13706b0ace79 tempest-DeleteServersTestJSON-1449419127 None] Deleting attachment 94b063ce-223d-46fa-9f15-b01db50628bf. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "cinder-e616ae21-6c88-440c-93db-a876fdfd48f3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "cinder-e616ae21-6c88-440c-93db-a876fdfd48f3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "cinder-quobyte-e616ae21-6c88-440c-93db-a876fdfd48f3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "cinder-quobyte-e616ae21-6c88-440c-93db-a876fdfd48f3" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf119294-c6d2-4a5c-a086-de4afd0eab20]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:13 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 Sep 23 00:13:13 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:14 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3" returned: 0 in 0.577s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:14 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3 Sep 23 00:13:14 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:14 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e616ae21-6c88-440c-93db-a876fdfd48f3" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "cinder-quobyte-e616ae21-6c88-440c-93db-a876fdfd48f3" released by "delete_volume" :: held 1.052s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Created reservations ['4987c301-bde3-4a7b-8fa2-4eb2f61a9eed', '23b35320-bcf4-49f0-87bb-4d8934477d68', '24806b06-c81a-454d-8a22-ed63a881d5a5', 'e4c391c1-5621-412f-a887-aa471b699075'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:14 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:13:14 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:14 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Deleted volume successfully. Sep 23 00:13:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-49e8510c-d01c-403d-a6f2-50f3c5950966 tempest-DeleteServersTestJSON-1449419127 None] Lock "cinder-e616ae21-6c88-440c-93db-a876fdfd48f3-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:24 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=41,cinder:SELECT=36,cinder:INSERT=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:24 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Flow 'volume_create_manager' (08f299f8-9c41-4793-8e9e-f8aa3e190c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5596bbe9-556c-4f98-9b1a-b1150914d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5596bbe9-556c-4f98-9b1a-b1150914d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-176697443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab00c541-25a6-4dd3-91e6-76187ed87771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2dd27b724c44eead2f5d04b94a989a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:40Z,use_quota=True,user_id='b5ec2a143f65469fb5c3dc6d41b55a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da969762-2930-405e-983a-4b6c2c436baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da969762-2930-405e-983a-4b6c2c436baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c5a61b-2544-491c-9043-1382dd19a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c5a61b-2544-491c-9043-1382dd19a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab00c541-25a6-4dd3-91e6-76187ed87771', 'volume_name': 'volume-ab00c541-25a6-4dd3-91e6-76187ed87771', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cad917c-64a1-41cb-9bfc-9213d7ac22ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cad917c-64a1-41cb-9bfc-9213d7ac22ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7679ed7-93fc-426d-9cde-9b2fb180f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Volume ab00c541-25a6-4dd3-91e6-76187ed87771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab00c541-25a6-4dd3-91e6-76187ed87771', 'volume_size': 1} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-176697443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab00c541-25a6-4dd3-91e6-76187ed87771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2dd27b724c44eead2f5d04b94a989a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:40Z,use_quota=True,user_id='b5ec2a143f65469fb5c3dc6d41b55a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Creating volume ab00c541-25a6-4dd3-91e6-76187ed87771 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:13:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:40 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 1073741824 Sep 23 00:13:40 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:41 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 1073741824" returned: 0 in 0.838s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:41 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 Sep 23 00:13:41 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:41 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7679ed7-93fc-426d-9cde-9b2fb180f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab00c541-25a6-4dd3-91e6-76187ed87771', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341b8489-7d05-49c7-bb50-ccfc13215af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Volume volume-ab00c541-25a6-4dd3-91e6-76187ed87771 (ab00c541-25a6-4dd3-91e6-76187ed87771): created successfully Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341b8489-7d05-49c7-bb50-ccfc13215af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Flow 'volume_create_manager' (08f299f8-9c41-4793-8e9e-f8aa3e190c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-877a6d61-9f22-485d-8245-5a0a708c0332 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Created volume successfully. Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Acquiring lock "cinder-ab00c541-25a6-4dd3-91e6-76187ed87771-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "cinder-ab00c541-25a6-4dd3-91e6-76187ed87771-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Acquiring lock "cinder-quobyte-ab00c541-25a6-4dd3-91e6-76187ed87771" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "cinder-quobyte-ab00c541-25a6-4dd3-91e6-76187ed87771" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ed8e7-ee48-4749-99c9-63aad4e92bcc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:44 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 Sep 23 00:13:44 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:44 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771" returned: 0 in 0.542s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:44 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771 Sep 23 00:13:44 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:45 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ab00c541-25a6-4dd3-91e6-76187ed87771" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "cinder-quobyte-ab00c541-25a6-4dd3-91e6-76187ed87771" released by "delete_volume" :: held 0.980s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Created reservations ['7a480b1c-69bb-4910-8742-7b87e8cbbf6f', 'a59f232b-3afa-43b9-a87c-3c2e6b7b49fe', '389f9b8c-06e7-4e95-90fe-db8811471542', '6ed56bf2-4a77-453b-b013-4cc16a29d6e5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:45 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:13:45 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:45 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Deleted volume successfully. Sep 23 00:13:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-569072c1-8763-4340-b15a-6c6d28074778 tempest-VolumeQuotasNegativeTestJSON-671385848 None] Lock "cinder-ab00c541-25a6-4dd3-91e6-76187ed87771-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:49 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:13:49 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:50 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-80bbc11b-5e04-4211-9dca-a972f47a3b92 req-6022f018-6919-4f3d-ab39-39a11f0d9e6c tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-80bbc11b-5e04-4211-9dca-a972f47a3b92 req-6022f018-6919-4f3d-ab39-39a11f0d9e6c tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-80bbc11b-5e04-4211-9dca-a972f47a3b92 req-6022f018-6919-4f3d-ab39-39a11f0d9e6c tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-80bbc11b-5e04-4211-9dca-a972f47a3b92 req-6022f018-6919-4f3d-ab39-39a11f0d9e6c tempest-ServerActionsTestOtherA-1637709275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64e5a71d-f818-4f06-8ca9-ab72d2399ad5', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-80bbc11b-5e04-4211-9dca-a972f47a3b92 req-6022f018-6919-4f3d-ab39-39a11f0d9e6c tempest-ServerActionsTestOtherA-1637709275 None] attachment_update completed successfully. Sep 23 00:14:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-72bd36f9-c21f-4691-9d60-420c76170623 tempest-ServerActionsTestOtherA-1637709275 None] Terminate volume connection completed successfully. Sep 23 00:14:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-72bd36f9-c21f-4691-9d60-420c76170623 tempest-ServerActionsTestOtherA-1637709275 None] Deleting attachment 64e5a71d-f818-4f06-8ca9-ab72d2399ad5. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Flow 'volume_create_manager' (a03832d5-a971-47cb-a0df-97bacd6ec8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76770112-26f9-4454-a438-a89cd749770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76770112-26f9-4454-a438-a89cd749770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-243361645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6edf2c-4788-4444-bb0f-de6ec75766a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63537376fe7649d997d8f26901dbeaf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:02Z,use_quota=True,user_id='375316a9f5a14d4684e8694145bf3274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4db0ee2c-3526-44e8-8742-c2f05aa3abb3),volume_type_id=4db0ee2c-3526-44e8-8742-c2f05aa3abb3)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029872f6-2695-4593-a21d-90d768680428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029872f6-2695-4593-a21d-90d768680428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e64502-2895-4340-809f-d9c42e5467c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e64502-2895-4340-809f-d9c42e5467c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6edf2c-4788-4444-bb0f-de6ec75766a2', 'volume_name': 'volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4695759-6025-4c53-a34b-c6b921d8e2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4695759-6025-4c53-a34b-c6b921d8e2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3792898-0575-446f-be33-e73c6b8f9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Volume 1c6edf2c-4788-4444-bb0f-de6ec75766a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2', 'volume_size': 1} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-243361645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6edf2c-4788-4444-bb0f-de6ec75766a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63537376fe7649d997d8f26901dbeaf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:02Z,use_quota=True,user_id='375316a9f5a14d4684e8694145bf3274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4db0ee2c-3526-44e8-8742-c2f05aa3abb3),volume_type_id=4db0ee2c-3526-44e8-8742-c2f05aa3abb3)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Creating volume 1c6edf2c-4788-4444-bb0f-de6ec75766a2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:14:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:02 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 1073741824 Sep 23 00:14:02 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-82ebb2c6-0fb2-4d83-8005-31c78ff7578d tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:03 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 1073741824" returned: 0 in 1.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:04 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 Sep 23 00:14:04 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:04 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-82ebb2c6-0fb2-4d83-8005-31c78ff7578d tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-82ebb2c6-0fb2-4d83-8005-31c78ff7578d tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3792898-0575-446f-be33-e73c6b8f9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d66be5-b06d-432a-8004-c03496ba4baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Volume volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 (1c6edf2c-4788-4444-bb0f-de6ec75766a2): created successfully Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d66be5-b06d-432a-8004-c03496ba4baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Flow 'volume_create_manager' (a03832d5-a971-47cb-a0df-97bacd6ec8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ac3c1e4a-07f3-4608-979f-f07a1da00302 tempest-VolumeTypesAccessTest-904095807 None] Created volume successfully. Sep 23 00:14:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-82ebb2c6-0fb2-4d83-8005-31c78ff7578d tempest-ServerActionsTestOtherA-1637709275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '786a76ec-016d-4964-95e6-0f92b12f0394', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c36d7ece-1f83-4710-ab6b-2cb2a915c3b9 req-82ebb2c6-0fb2-4d83-8005-31c78ff7578d tempest-ServerActionsTestOtherA-1637709275 None] attachment_update completed successfully. Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Acquiring lock "cinder-1c6edf2c-4788-4444-bb0f-de6ec75766a2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "cinder-1c6edf2c-4788-4444-bb0f-de6ec75766a2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Acquiring lock "cinder-quobyte-1c6edf2c-4788-4444-bb0f-de6ec75766a2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "cinder-quobyte-1c6edf2c-4788-4444-bb0f-de6ec75766a2" acquired by "delete_volume" :: waited 0.058s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec4ed9-0fe2-49d7-93e0-58ed2f9a6966]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:06 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 Sep 23 00:14:06 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:06 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2" returned: 0 in 0.938s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:06 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2 Sep 23 00:14:06 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:07 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c6edf2c-4788-4444-bb0f-de6ec75766a2" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "cinder-quobyte-1c6edf2c-4788-4444-bb0f-de6ec75766a2" released by "delete_volume" :: held 1.568s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-591807649 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-591807649, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:14:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-591807649 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-591807649, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Created reservations ['66c5e7f9-905f-4aa2-b3ac-c42b40938134', '794b7c29-680f-4254-b5f6-6c6071492760', '7d7386cd-93c3-4ed2-83bb-e032a18f6d77', 'f676a127-a18e-4540-a782-924da3962a28'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:07 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:14:07 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:08 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.978s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Deleted volume successfully. Sep 23 00:14:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-73bd20a8-d906-4a57-9d68-05f1fe0cdda6 tempest-VolumeTypesAccessTest-904095807 None] Lock "cinder-1c6edf2c-4788-4444-bb0f-de6ec75766a2-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=33,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Flow 'volume_create_manager' (abfca054-b42b-4d11-b141-00bb7c846d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab5a905-a3db-49cf-8ae7-60caed3eefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab5a905-a3db-49cf-8ae7-60caed3eefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-207617019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6d6a95-3b65-4423-af18-f17929c41a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb5c5c3123343b5b02a2e72f1dd962b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:19Z,use_quota=True,user_id='8c4808b5a4b94908b02675dd29f8aa2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97b24d-6f63-44fc-89e5-068e9254b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97b24d-6f63-44fc-89e5-068e9254b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcd2ae2-4e66-4740-84cb-def776291050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcd2ae2-4e66-4740-84cb-def776291050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6d6a95-3b65-4423-af18-f17929c41a1b', 'volume_name': 'volume-8c6d6a95-3b65-4423-af18-f17929c41a1b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a7621b-c7a2-4c09-ac70-8ec4601dfc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a7621b-c7a2-4c09-ac70-8ec4601dfc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d0ce2a-dc78-4397-b709-a74421de986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Volume 8c6d6a95-3b65-4423-af18-f17929c41a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6d6a95-3b65-4423-af18-f17929c41a1b', 'volume_size': 1} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-207617019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6d6a95-3b65-4423-af18-f17929c41a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb5c5c3123343b5b02a2e72f1dd962b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:19Z,use_quota=True,user_id='8c4808b5a4b94908b02675dd29f8aa2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Creating volume 8c6d6a95-3b65-4423-af18-f17929c41a1b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:14:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:19 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b 1073741824 Sep 23 00:14:19 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:21 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b 1073741824" returned: 0 in 1.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:21 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b Sep 23 00:14:21 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:21 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d0ce2a-dc78-4397-b709-a74421de986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6d6a95-3b65-4423-af18-f17929c41a1b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5125e1b-5393-4f42-9889-a8c11b8b715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Volume volume-8c6d6a95-3b65-4423-af18-f17929c41a1b (8c6d6a95-3b65-4423-af18-f17929c41a1b): created successfully Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5125e1b-5393-4f42-9889-a8c11b8b715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Flow 'volume_create_manager' (abfca054-b42b-4d11-b141-00bb7c846d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-91832902-58bc-474c-831a-fa872599f0d5 tempest-AttachVolumeShelveTestJSON-572426946 None] Created volume successfully. Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Flow 'volume_create_manager' (427f466f-e832-4420-a753-50a2292ffb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b58d8da-3360-4983-9784-32ece7a2602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b58d8da-3360-4983-9784-32ece7a2602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1461314511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591d2590-b8b5-4dc5-a656-8796f6cb0585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e6cab32344da4878394ef9d51b7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:29Z,use_quota=True,user_id='6d503bd97f9a405984779903b66d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ed6c04-e8bf-4b40-9dea-8eb748ded8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ed6c04-e8bf-4b40-9dea-8eb748ded8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70f2ed9-997b-4841-91be-dd35423da356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70f2ed9-997b-4841-91be-dd35423da356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591d2590-b8b5-4dc5-a656-8796f6cb0585', 'volume_name': 'volume-591d2590-b8b5-4dc5-a656-8796f6cb0585', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072d56d-cc0c-4cc0-99d6-d5d90f573fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072d56d-cc0c-4cc0-99d6-d5d90f573fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae2655-9d43-4a09-84bf-f182abcef0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Volume 591d2590-b8b5-4dc5-a656-8796f6cb0585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591d2590-b8b5-4dc5-a656-8796f6cb0585', 'volume_size': 1} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1461314511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591d2590-b8b5-4dc5-a656-8796f6cb0585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e6cab32344da4878394ef9d51b7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:29Z,use_quota=True,user_id='6d503bd97f9a405984779903b66d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Creating volume 591d2590-b8b5-4dc5-a656-8796f6cb0585 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:14:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:29 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 1073741824 Sep 23 00:14:29 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:30 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 1073741824" returned: 0 in 0.969s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:30 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 Sep 23 00:14:30 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:30 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae2655-9d43-4a09-84bf-f182abcef0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591d2590-b8b5-4dc5-a656-8796f6cb0585', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67af850c-eed2-4216-a338-5b83ae69b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Volume volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 (591d2590-b8b5-4dc5-a656-8796f6cb0585): created successfully Sep 23 00:14:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67af850c-eed2-4216-a338-5b83ae69b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Flow 'volume_create_manager' (427f466f-e832-4420-a753-50a2292ffb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-086b3cc3-c37a-41a0-ba08-d317d3652e87 tempest-ServersNegativeTestJSON-1713518970 None] Created volume successfully. Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Flow 'volume_create_manager' (2be63634-f095-4f29-be6c-0f323e32273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60031083-77df-437e-8bc7-2284d590c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60031083-77df-437e-8bc7-2284d590c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-489937923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd414a7-b94c-489f-b132-d69f305c8baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e6cab32344da4878394ef9d51b7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:34Z,use_quota=True,user_id='6d503bd97f9a405984779903b66d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d40926-953f-4b51-aab3-394c0657367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d40926-953f-4b51-aab3-394c0657367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649dca67-0734-4603-bfec-62e20407c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649dca67-0734-4603-bfec-62e20407c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd414a7-b94c-489f-b132-d69f305c8baa', 'volume_name': 'volume-1fd414a7-b94c-489f-b132-d69f305c8baa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26691727-3d82-4b41-8b34-fa312393b820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26691727-3d82-4b41-8b34-fa312393b820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24aedfa8-c797-4d1a-8b01-8f6d297871f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Volume 1fd414a7-b94c-489f-b132-d69f305c8baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd414a7-b94c-489f-b132-d69f305c8baa', 'volume_size': 1} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-489937923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd414a7-b94c-489f-b132-d69f305c8baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e6cab32344da4878394ef9d51b7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:34Z,use_quota=True,user_id='6d503bd97f9a405984779903b66d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Creating volume 1fd414a7-b94c-489f-b132-d69f305c8baa {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:14:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:34 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa 1073741824 Sep 23 00:14:34 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa 1073741824" returned: 0 in 0.982s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:35 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa Sep 23 00:14:35 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:35 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24aedfa8-c797-4d1a-8b01-8f6d297871f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd414a7-b94c-489f-b132-d69f305c8baa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd52468-1750-46ca-a367-c7ad4c9eb27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Volume volume-1fd414a7-b94c-489f-b132-d69f305c8baa (1fd414a7-b94c-489f-b132-d69f305c8baa): created successfully Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd52468-1750-46ca-a367-c7ad4c9eb27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Flow 'volume_create_manager' (2be63634-f095-4f29-be6c-0f323e32273b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28156c0a-f059-4a43-8e31-8aade3106b51 tempest-ServersNegativeTestJSON-1713518970 None] Created volume successfully. Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "cinder-1fd414a7-b94c-489f-b132-d69f305c8baa-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-1fd414a7-b94c-489f-b132-d69f305c8baa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "cinder-quobyte-1fd414a7-b94c-489f-b132-d69f305c8baa" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-quobyte-1fd414a7-b94c-489f-b132-d69f305c8baa" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d123fcc7-f6b3-4243-939b-9a1e1c0cce3d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:37 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa Sep 23 00:14:37 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4f50197c-31a9-40a9-a6b1-803595e4facf req-07bfbf14-b28a-4244-a06b-6e0cb4633776 tempest-AttachVolumeShelveTestJSON-572426946 None] No connector for attachment 0030f99e-b210-4c12-93ea-03864f79512a; skipping storage backend terminate_connection call. {{(pid=87132) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4f50197c-31a9-40a9-a6b1-803595e4facf req-07bfbf14-b28a-4244-a06b-6e0cb4633776 tempest-AttachVolumeShelveTestJSON-572426946 None] Deleting attachment 0030f99e-b210-4c12-93ea-03864f79512a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:38 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:38 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa Sep 23 00:14:38 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:38 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1fd414a7-b94c-489f-b132-d69f305c8baa" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-quobyte-1fd414a7-b94c-489f-b132-d69f305c8baa" released by "delete_volume" :: held 1.111s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Created reservations ['40f35cc9-6362-467d-b64d-8bbba8569d85', 'af98a585-85c2-41a0-956f-c99bec4dcc2b', '744cafdc-790b-4d9b-aec0-16002aebe0fb', '1d3ec800-f32b-4f99-8ce4-87c1aebb4953'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:39 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:14:39 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:39 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:39 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Deleted volume successfully. Sep 23 00:14:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-efae60c2-c288-4189-b3a6-a1a4feec6919 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-1fd414a7-b94c-489f-b132-d69f305c8baa-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "cinder-591d2590-b8b5-4dc5-a656-8796f6cb0585-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-591d2590-b8b5-4dc5-a656-8796f6cb0585-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "cinder-quobyte-591d2590-b8b5-4dc5-a656-8796f6cb0585" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-quobyte-591d2590-b8b5-4dc5-a656-8796f6cb0585" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f3e4d-ecce-4cc9-9ce0-4303ade05414]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:40 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 Sep 23 00:14:40 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:40 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585" returned: 0 in 0.693s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:40 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585 Sep 23 00:14:40 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:41 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-591d2590-b8b5-4dc5-a656-8796f6cb0585" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-quobyte-591d2590-b8b5-4dc5-a656-8796f6cb0585" released by "delete_volume" :: held 1.339s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Created reservations ['34a0a6f4-0791-4ca3-84c5-26558e728dd4', '834a9edc-a19e-4d0c-a690-7f77e8ab2cc7', 'd5047e8d-9fd3-4a11-b5c9-c16cd691e7fd', '55aebdb6-8acb-43f1-aa8c-1c1468c1e4b2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:41 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:14:41 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:42 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Deleted volume successfully. Sep 23 00:14:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5c7c022-ff1a-41c7-aecc-235587bbcfc1 tempest-ServersNegativeTestJSON-1713518970 None] Lock "cinder-591d2590-b8b5-4dc5-a656-8796f6cb0585-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:14:49 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:50 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 8 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:51 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=24,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b7095923-b8d1-41b3-b4aa-51911e7853f4 req-c103d1d8-742e-402c-93a0-8ab14cb997f4 tempest-ServerActionsTestOtherA-1637709275 None] Terminate volume connection completed successfully. Sep 23 00:14:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b7095923-b8d1-41b3-b4aa-51911e7853f4 req-c103d1d8-742e-402c-93a0-8ab14cb997f4 tempest-ServerActionsTestOtherA-1637709275 None] Deleting attachment 786a76ec-016d-4964-95e6-0f92b12f0394. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Flow 'volume_create_manager' (e3cb7524-822a-4e3d-8f34-b7c97c4a3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6b8d5-6a60-47c8-a5ae-30fcacd755f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6b8d5-6a60-47c8-a5ae-30fcacd755f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-802338259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1798bec3-9a35-4395-aa14-5dd528f99311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ac0d210264a7198e21bd3ab792911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:57Z,use_quota=True,user_id='6f0a1a703a80418eacdb25843ef78301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09aaef20-e68c-457a-8a53-e6f96a59a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09aaef20-e68c-457a-8a53-e6f96a59a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38932665-d0f4-47b6-a4a5-bdfe0e2ae57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38932665-d0f4-47b6-a4a5-bdfe0e2ae57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1798bec3-9a35-4395-aa14-5dd528f99311', 'volume_name': 'volume-1798bec3-9a35-4395-aa14-5dd528f99311', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad149d3-22a3-4316-9164-3f47ab067bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad149d3-22a3-4316-9164-3f47ab067bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e6bf50-3335-48fa-b580-9584dae88e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Volume 1798bec3-9a35-4395-aa14-5dd528f99311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1798bec3-9a35-4395-aa14-5dd528f99311', 'volume_size': 1} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-802338259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1798bec3-9a35-4395-aa14-5dd528f99311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ac0d210264a7198e21bd3ab792911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:57Z,use_quota=True,user_id='6f0a1a703a80418eacdb25843ef78301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Creating volume 1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:57 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 1073741824 Sep 23 00:14:57 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:57 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 1073741824" returned: 0 in 0.598s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:57 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 Sep 23 00:14:57 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:58 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311" returned: 0 in 0.480s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e6bf50-3335-48fa-b580-9584dae88e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1798bec3-9a35-4395-aa14-5dd528f99311', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98af32-f0e8-44df-901e-666dd087a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Volume volume-1798bec3-9a35-4395-aa14-5dd528f99311 (1798bec3-9a35-4395-aa14-5dd528f99311): created successfully Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c98af32-f0e8-44df-901e-666dd087a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Flow 'volume_create_manager' (e3cb7524-822a-4e3d-8f34-b7c97c4a3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-22de2911-9ee4-476a-b44b-c6c8efd1c68c tempest-SnapshotMetadataTestJSON-452955140 None] Created volume successfully. Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Creating offline snapshot c61b0318-1567-4ff9-986f-cb8f90e99b95 of volume 1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96546ed-fa16-47e6-86b7-1c5054360582]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:59 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 Sep 23 00:14:59 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:59 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 1G Sep 23 00:15:00 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Flow 'volume_create_manager' (e4850a97-fb6e-4fbe-803f-43ff22c08c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703efe22-7260-4cc6-adb6-f31155fe9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703efe22-7260-4cc6-adb6-f31155fe9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-337203518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04aff1d164779a9e09c43d4e60d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='4941fda44a1a4dfa906dcb121c315278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9cf03e-7e94-497e-bdfd-12d6cf1f4911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9cf03e-7e94-497e-bdfd-12d6cf1f4911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a470f8-9e28-4754-8a60-c14a4e78e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a470f8-9e28-4754-8a60-c14a4e78e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb', 'volume_name': 'volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a16426-a5de-49df-975e-e663b2602c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a16426-a5de-49df-975e-e663b2602c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246d99d8-2259-4914-9826-7f7787376f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Volume 0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb', 'volume_size': 1} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:00 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 1G" returned: 0 in 0.784s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798bec3-9a35-4395-aa14-5dd528f99311 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:00 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798bec3-9a35-4395-aa14-5dd528f99311 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 Sep 23 00:15:00 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798bec3-9a35-4395-aa14-5dd528f99311 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 is being set with open permissions: ugo+rw Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:01 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 Sep 23 00:15:01 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:01 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info Sep 23 00:15:01 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:01 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:01 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info is being set with open permissions: ugo+rw Sep 23 00:15:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info Sep 23 00:15:02 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:02 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.info" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-337203518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2a04aff1d164779a9e09c43d4e60d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:00Z,use_quota=True,user_id='4941fda44a1a4dfa906dcb121c315278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Creating volume 0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:15:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb 1073741824 Sep 23 00:15:02 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2cc93f97-d5e1-4361-b969-caba2a1e6864 tempest-SnapshotMetadataTestJSON-452955140 None] Create snapshot completed successfully Sep 23 00:15:03 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb 1073741824" returned: 0 in 0.784s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:03 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb Sep 23 00:15:03 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" returned: 0 in 0.694s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246d99d8-2259-4914-9826-7f7787376f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a56545-11df-4e49-b622-9282336366dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Flow 'volume_create_manager' (9d093e26-ef2e-480b-bfa1-981ea7cc426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65eb774f-490e-4108-95da-f06f2b7506ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65eb774f-490e-4108-95da-f06f2b7506ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1661654598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1062ed-d7c9-482e-9bc5-b00c973b6458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eeb9decf884b609654a3d2a1c24f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:04Z,use_quota=True,user_id='8ea3ef64dc3649cf8ff25bcee9e9532d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e155cc-c8b0-48fd-ae89-fe9c9047dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e155cc-c8b0-48fd-ae89-fe9c9047dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c16263-c5c1-4292-ac44-b98ca3ed6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:15:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Volume volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb (0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb): created successfully Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a56545-11df-4e49-b622-9282336366dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Flow 'volume_create_manager' (e4850a97-fb6e-4fbe-803f-43ff22c08c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "cinder-c61b0318-1567-4ff9-986f-cb8f90e99b95-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-69753f48-d2a4-4acc-8248-affd01874947 req-9b2b13ad-e1df-4223-aeb8-4f2fc4bed56c tempest-VolumesGetTestJSON-1064317648 None] Created volume successfully. Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-c61b0318-1567-4ff9-986f-cb8f90e99b95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "cinder-quobyte-c61b0318-1567-4ff9-986f-cb8f90e99b95" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-c61b0318-1567-4ff9-986f-cb8f90e99b95" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Deleting offline snapshot c61b0318-1567-4ff9-986f-cb8f90e99b95 of volume 1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] snapshot_file for this snap is: volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c19590e-3a4c-496a-b377-1d6235f6b4b0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[91894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 Sep 23 00:15:04 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:04 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c16263-c5c1-4292-ac44-b98ca3ed6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'volume_name': 'volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2c3ce5-64a8-4f1f-9ba3-858ddafb636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2c3ce5-64a8-4f1f-9ba3-858ddafb636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5a833c-98e8-4c5a-abd7-85d7dbc3fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Trying to clone 2f1062ed-d7c9-482e-9bc5-b00c973b6458 from image 7ff22cbd-c151-45fd-8a05-f05c376811bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1798bec3-9a35-4395-aa14-5dd528f99311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[650463b7-8d45-4474-82b5-78717370846b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 Sep 23 00:15:05 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Acquiring lock "cinder-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "cinder-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:15:05 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Acquiring lock "cinder-quobyte-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "cinder-quobyte-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[904f15a6-d35e-4a47-bb0a-5c1e65b7de68]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e7078b-bae6-4657-857b-f6bbf22bd8f7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311" returned: 0 in 0.841s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 Sep 23 00:15:05 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb Sep 23 00:15:06 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD Sep 23 00:15:06 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc is fetched for user 8ea3ef64dc3649cf8ff25bcee9e9532d. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:15:06 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb Sep 23 00:15:06 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95 Sep 23 00:15:06 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad4bf1-941c-45a5-b509-20ebdcc10d75]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "cinder-quobyte-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb" released by "delete_volume" :: held 0.951s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:06 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD Sep 23 00:15:06 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311.c61b0318-1567-4ff9-986f-cb8f90e99b95" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG cinder.quota [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Created reservations ['bda401cf-76bb-4ae3-926f-4398d591cc81', 'd9802e30-9fb1-49fd-a52b-2e89897c86ae', 'f1738328-305c-403f-a8d5-82d8e30c03f6', '97846415-7cc1-4b83-bf29-c4448f39134a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-c61b0318-1567-4ff9-986f-cb8f90e99b95" released by "_delete_snapshot" :: held 2.613s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" released by "delete_snapshot" :: held 2.671s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Created reservations ['460ef630-3552-4516-bd65-1658aff5fc9d', '157b9406-f80e-49e5-b0e8-3fe886a422c5', 'f026b0ca-0392-4e6f-9e6f-2d615afd4a4c', '5d7174d3-45b4-42b5-ae9c-9710bef9ed4a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:07 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:07 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1661654598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1062ed-d7c9-482e-9bc5-b00c973b6458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eeb9decf884b609654a3d2a1c24f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:04Z,use_quota=True,user_id='8ea3ef64dc3649cf8ff25bcee9e9532d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Creating volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1073741824 Sep 23 00:15:07 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Delete snapshot completed successfully. Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4048a369-6765-4067-92bb-c26c86f063b0 tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-c61b0318-1567-4ff9-986f-cb8f90e99b95-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:07 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.manager [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Deleted volume successfully. Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-c44627a4-8ff9-442c-a4f8-f0245668c1e4 req-f2a1d312-cd9b-4674-87a1-02c441112b43 tempest-VolumesGetTestJSON-1064317648 None] Lock "cinder-0c3ca6f3-f34b-46e7-8b0f-59adcb0780bb-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "cinder-1798bec3-9a35-4395-aa14-5dd528f99311-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-1798bec3-9a35-4395-aa14-5dd528f99311-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ace5d-1e85-4e0e-90c8-f5d33f099b9f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1073741824" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 Sep 23 00:15:07 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 Sep 23 00:15:07 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Attempting download of 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:15:08 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311 Sep 23 00:15:08 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[81000965-8ef4-4ba8-b93e-8399748ccaba]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2 Sep 23 00:15:08 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1798bec3-9a35-4395-aa14-5dd528f99311" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-quobyte-1798bec3-9a35-4395-aa14-5dd528f99311" released by "delete_volume" :: held 0.893s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Created reservations ['240719ac-6794-46ca-9650-d579afe86d71', 'a02b0873-a1ba-4e2c-8f10-4377619b72d6', '470d967a-f1ca-45b6-9494-fde6924969be', '4c610c2e-94e1-4ae3-ae9e-7c48bf0a9784'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:08 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:08 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2 Sep 23 00:15:08 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Deleted volume successfully. Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-02258cc8-5aed-465f-ab54-d55cfcfa6dae tempest-SnapshotMetadataTestJSON-452955140 None] Lock "cinder-1798bec3-9a35-4395-aa14-5dd528f99311-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:09 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2" returned: 1 in 0.544s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_9yubree2' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f27e65-f549-4d6b-b3f5-c1e740619429]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:09 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD Sep 23 00:15:09 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] 7ff22cbd-c151-45fd-8a05-f05c376811bc was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:15:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:09 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 Sep 23 00:15:09 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:12 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458" returned: 0 in 2.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_gpioz2lxdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:12 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Converted 112.00 MB image at 42.45 MB/s Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:12 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1G Sep 23 00:15:12 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:12 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 1G" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Downloaded image 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc for user 8ea3ef64dc3649cf8ff25bcee9e9532d is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Marking volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Copying metadata from image 7ff22cbd-c151-45fd-8a05-f05c376811bc to 2f1062ed-d7c9-482e-9bc5-b00c973b6458. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:15:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Creating volume glance metadata for volume 2f1062ed-d7c9-482e-9bc5-b00c973b6458 backed by image 7ff22cbd-c151-45fd-8a05-f05c376811bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:15:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5a833c-98e8-4c5a-abd7-85d7dbc3fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a613e23e-5bab-43c8-930c-c2c13714ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Volume volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 (2f1062ed-d7c9-482e-9bc5-b00c973b6458): created successfully Sep 23 00:15:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a613e23e-5bab-43c8-930c-c2c13714ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Flow 'volume_create_manager' (9d093e26-ef2e-480b-bfa1-981ea7cc426b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-66302b7f-cbbf-4310-a7b3-37873093456e tempest-ServerActionsTestOtherA-1637709275 None] Created volume successfully. Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Flow 'volume_create_manager' (9a2c05ae-ca50-45b2-8b71-01a0eb5d9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa679e-065d-47e8-9cae-f13a7d560abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa679e-065d-47e8-9cae-f13a7d560abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1583862434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac6c860-825b-490e-8ab2-64f6a1632028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e22f8e8714322a904e8f3fe70711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:17Z,use_quota=True,user_id='4b65ea37033145e28f6338ef6f026281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d270ff-e992-49d8-ba92-1b53f9c44848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d270ff-e992-49d8-ba92-1b53f9c44848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a90b98-4f4b-4559-a621-c82084fb6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a90b98-4f4b-4559-a621-c82084fb6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac6c860-825b-490e-8ab2-64f6a1632028', 'volume_name': 'volume-fac6c860-825b-490e-8ab2-64f6a1632028', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0144ba-9a2b-4acc-912d-a46774a6924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0144ba-9a2b-4acc-912d-a46774a6924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538cc303-f103-4003-8154-35a5ffc3efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Volume fac6c860-825b-490e-8ab2-64f6a1632028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac6c860-825b-490e-8ab2-64f6a1632028', 'volume_size': 1} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1583862434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac6c860-825b-490e-8ab2-64f6a1632028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e22f8e8714322a904e8f3fe70711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:17Z,use_quota=True,user_id='4b65ea37033145e28f6338ef6f026281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Creating volume fac6c860-825b-490e-8ab2-64f6a1632028 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:17 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 1073741824 Sep 23 00:15:17 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e4ade8a7-0b60-474a-94c9-375b63577c07 req-581f9e4f-2004-4308-b775-0e4143df6161 tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:18 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 1073741824" returned: 0 in 0.631s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:18 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 Sep 23 00:15:18 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:18 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e4ade8a7-0b60-474a-94c9-375b63577c07 req-581f9e4f-2004-4308-b775-0e4143df6161 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.087s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538cc303-f103-4003-8154-35a5ffc3efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac6c860-825b-490e-8ab2-64f6a1632028', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fc34e-bda5-4ddb-b637-984924d82036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-e4ade8a7-0b60-474a-94c9-375b63577c07 req-581f9e4f-2004-4308-b775-0e4143df6161 tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Volume volume-fac6c860-825b-490e-8ab2-64f6a1632028 (fac6c860-825b-490e-8ab2-64f6a1632028): created successfully Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fc34e-bda5-4ddb-b637-984924d82036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Flow 'volume_create_manager' (9a2c05ae-ca50-45b2-8b71-01a0eb5d9914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-95b680c9-d2b6-442b-abc2-c3db454bb254 tempest-VolumesTransfersTest-326031413 None] Created volume successfully. Sep 23 00:15:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-e4ade8a7-0b60-474a-94c9-375b63577c07 req-581f9e4f-2004-4308-b775-0e4143df6161 tempest-ServerActionsTestOtherA-1637709275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8cc3bbe-9880-4447-8e0e-a8096531c01c', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-e4ade8a7-0b60-474a-94c9-375b63577c07 req-581f9e4f-2004-4308-b775-0e4143df6161 tempest-ServerActionsTestOtherA-1637709275 None] attachment_update completed successfully. Sep 23 00:15:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-499f4a86-aaa1-4dac-9834-8f291a4e04ce tempest-VolumesTransfersTest-212949077 None] Transfer volume completed successfully. Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Acquiring lock "cinder-fac6c860-825b-490e-8ab2-64f6a1632028-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "cinder-fac6c860-825b-490e-8ab2-64f6a1632028-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Acquiring lock "cinder-quobyte-fac6c860-825b-490e-8ab2-64f6a1632028" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "cinder-quobyte-fac6c860-825b-490e-8ab2-64f6a1632028" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[596befb2-6b69-443b-991e-dd102042b38b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 Sep 23 00:15:22 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028 Sep 23 00:15:22 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:22 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fac6c860-825b-490e-8ab2-64f6a1632028" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "cinder-quobyte-fac6c860-825b-490e-8ab2-64f6a1632028" released by "delete_volume" :: held 1.035s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Created reservations ['126ffae7-95be-4f3e-b455-0b556f4b60ad', 'ea5e4956-cc92-4993-aaae-8d4278c6f5bc', '2cfc4ecb-2bda-45e6-ba5c-3eb3ea6a9cc1', 'da85bcb1-8896-4fe3-b88e-3c398681df5e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:23 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:23 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:23 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Deleted volume successfully. Sep 23 00:15:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93c80422-f1bb-4e41-b064-fea9435f4674 tempest-VolumesTransfersTest-369201147 None] Lock "cinder-fac6c860-825b-490e-8ab2-64f6a1632028-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Acquiring lock "cinder-8c6d6a95-3b65-4423-af18-f17929c41a1b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "cinder-8c6d6a95-3b65-4423-af18-f17929c41a1b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Acquiring lock "cinder-quobyte-8c6d6a95-3b65-4423-af18-f17929c41a1b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "cinder-quobyte-8c6d6a95-3b65-4423-af18-f17929c41a1b" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6336b5-334e-44c7-89a3-ea0656641ff0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:24 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b Sep 23 00:15:24 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Flow 'volume_create_manager' (83acda01-b60f-452b-a014-bede1689bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9370656c-36a6-44ce-9fa5-670c5b456aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9370656c-36a6-44ce-9fa5-670c5b456aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-298457312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9b1901-8e15-4611-8bad-aa6a90471e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e22f8e8714322a904e8f3fe70711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='4b65ea37033145e28f6338ef6f026281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8858d99f-940b-4b85-a5ec-7d06833a76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8858d99f-940b-4b85-a5ec-7d06833a76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992c7c73-94f7-4075-bb20-eb2eceb3bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992c7c73-94f7-4075-bb20-eb2eceb3bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9b1901-8e15-4611-8bad-aa6a90471e73', 'volume_name': 'volume-ad9b1901-8e15-4611-8bad-aa6a90471e73', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7b1010-074b-4d41-adc7-83cf9a459919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7b1010-074b-4d41-adc7-83cf9a459919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b620b02b-5867-4f32-a3b1-ac0c485bf586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Volume ad9b1901-8e15-4611-8bad-aa6a90471e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9b1901-8e15-4611-8bad-aa6a90471e73', 'volume_size': 1} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-298457312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9b1901-8e15-4611-8bad-aa6a90471e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89e22f8e8714322a904e8f3fe70711d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='4b65ea37033145e28f6338ef6f026281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Creating volume ad9b1901-8e15-4611-8bad-aa6a90471e73 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:25 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 1073741824 Sep 23 00:15:25 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b Sep 23 00:15:25 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:26 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8c6d6a95-3b65-4423-af18-f17929c41a1b" returned: 0 in 0.667s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "cinder-quobyte-8c6d6a95-3b65-4423-af18-f17929c41a1b" released by "delete_volume" :: held 1.465s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:26 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 1073741824" returned: 0 in 0.917s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Created reservations ['357974f7-7773-4bc8-b60a-eb55231fc74a', '812dc09e-c42f-44ab-a677-2cb6f1f0a43c', '71c83f90-c08d-4e6f-8d9e-c4a59e41e3be', '3e373566-96d4-4d91-ad71-d4108ce215ef'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:26 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 Sep 23 00:15:26 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:26 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:26 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:27 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:27 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73" returned: 0 in 0.713s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Deleted volume successfully. Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b620b02b-5867-4f32-a3b1-ac0c485bf586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9b1901-8e15-4611-8bad-aa6a90471e73', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6d55f-8b56-48fc-b744-17fa2d451f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3794a80-acb4-46e7-b5b0-e95c63d47573 tempest-AttachVolumeShelveTestJSON-572426946 None] Lock "cinder-8c6d6a95-3b65-4423-af18-f17929c41a1b-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Volume volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 (ad9b1901-8e15-4611-8bad-aa6a90471e73): created successfully Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6d55f-8b56-48fc-b744-17fa2d451f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Flow 'volume_create_manager' (83acda01-b60f-452b-a014-bede1689bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2176324c-28b9-414f-a779-e2d4750f0197 tempest-VolumesTransfersTest-326031413 None] Created volume successfully. Sep 23 00:15:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Acquiring lock "cinder-ad9b1901-8e15-4611-8bad-aa6a90471e73-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "cinder-ad9b1901-8e15-4611-8bad-aa6a90471e73-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Acquiring lock "cinder-quobyte-ad9b1901-8e15-4611-8bad-aa6a90471e73" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "cinder-quobyte-ad9b1901-8e15-4611-8bad-aa6a90471e73" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fdd2cd-7406-467c-b174-543aa6c108dd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:28 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 Sep 23 00:15:28 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:29 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73" returned: 0 in 0.786s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:29 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73 Sep 23 00:15:29 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:29 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad9b1901-8e15-4611-8bad-aa6a90471e73" returned: 0 in 0.629s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "cinder-quobyte-ad9b1901-8e15-4611-8bad-aa6a90471e73" released by "delete_volume" :: held 1.514s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Created reservations ['8e8b5569-4989-4d43-962c-7d869833c962', 'e4824174-e09e-4443-b691-1505ba4e7dbf', 'f7fb7eac-bf34-4ce5-83e5-e4d6c08f286f', 'b61b7d85-23b8-4671-8d74-92cdf95ba023'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:30 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:30 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:30 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Deleted volume successfully. Sep 23 00:15:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-05dac1c1-21f7-4464-91a3-c6935b4cb31d tempest-VolumesTransfersTest-369201147 None] Lock "cinder-ad9b1901-8e15-4611-8bad-aa6a90471e73-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=65,cinder:UPDATE=61,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=54,cinder:UPDATE=69,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:49 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:49 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.586s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Flow 'volume_create_manager' (18c7cf36-be5b-4b8e-bbc9-ee88c6863217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928b417e-ee5f-4ac7-8e46-6346f383b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928b417e-ee5f-4ac7-8e46-6346f383b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-949690042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efc9bea-2b75-442e-8efd-63d5ae49ff72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7a98bc1a02475ca61fd75e8ac188c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:52Z,use_quota=True,user_id='74e45e5a9b3548fa86dcda8da2b88c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfcab56-a9fc-45c0-873f-16fa0a0605e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfcab56-a9fc-45c0-873f-16fa0a0605e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41c8120-670e-476b-870d-56fce5458cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41c8120-670e-476b-870d-56fce5458cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efc9bea-2b75-442e-8efd-63d5ae49ff72', 'volume_name': 'volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba7458a-1302-4ea6-8b9c-8cdc5478f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba7458a-1302-4ea6-8b9c-8cdc5478f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5210b60f-8827-4896-9310-a69d04a5cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Volume 7efc9bea-2b75-442e-8efd-63d5ae49ff72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72', 'volume_size': 1} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-949690042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efc9bea-2b75-442e-8efd-63d5ae49ff72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7a98bc1a02475ca61fd75e8ac188c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:52Z,use_quota=True,user_id='74e45e5a9b3548fa86dcda8da2b88c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Creating volume 7efc9bea-2b75-442e-8efd-63d5ae49ff72 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:52 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:15:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:52 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 1073741824 Sep 23 00:15:52 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 1073741824" returned: 0 in 0.833s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:53 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 Sep 23 00:15:53 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72" returned: 0 in 0.619s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5210b60f-8827-4896-9310-a69d04a5cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32d5daa-3b32-4697-a169-9a00c41b1447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Volume volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 (7efc9bea-2b75-442e-8efd-63d5ae49ff72): created successfully Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32d5daa-3b32-4697-a169-9a00c41b1447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Flow 'volume_create_manager' (18c7cf36-be5b-4b8e-bbc9-ee88c6863217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e8a8ada4-0d86-4d2a-8a8f-b2102cc24797 tempest-VolumesTransfersV357Test-1139781868 None] Created volume successfully. Sep 23 00:15:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-82a88bc1-5b55-4f4d-9452-a069b6e194e1 tempest-VolumesTransfersV357Test-1046055501 None] Transfer volume completed successfully. Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "cinder-7efc9bea-2b75-442e-8efd-63d5ae49ff72-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-7efc9bea-2b75-442e-8efd-63d5ae49ff72-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "cinder-quobyte-7efc9bea-2b75-442e-8efd-63d5ae49ff72" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-quobyte-7efc9bea-2b75-442e-8efd-63d5ae49ff72" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb577d01-1bbc-496c-80fb-29fff4538c7f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 Sep 23 00:15:57 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:57 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72" returned: 0 in 0.820s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72 Sep 23 00:15:57 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:58 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7efc9bea-2b75-442e-8efd-63d5ae49ff72" returned: 0 in 0.544s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-quobyte-7efc9bea-2b75-442e-8efd-63d5ae49ff72" released by "delete_volume" :: held 1.476s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Created reservations ['2efe5848-2e4d-4d02-8205-77146ee8c5ad', '866bab30-f259-4e01-8ffd-bace9412f88c', '57481daa-a56b-4f76-82f7-35956f3ae523', 'a0a26b85-b82c-47fc-bfcd-c8440c76f7c2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:58 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:15:58 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-cb321301-1c0f-492e-a522-98febf86ddf1 tempest-ServerActionsTestOtherA-1637709275 None] Terminate volume connection completed successfully. Sep 23 00:15:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-cb321301-1c0f-492e-a522-98febf86ddf1 tempest-ServerActionsTestOtherA-1637709275 None] Deleting attachment e8cc3bbe-9880-4447-8e0e-a8096531c01c. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:59 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Deleted volume successfully. Sep 23 00:15:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-75002a55-8dbd-43f6-bacb-c42e6ab1b231 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-7efc9bea-2b75-442e-8efd-63d5ae49ff72-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Flow 'volume_create_manager' (22fdd7b8-a58a-42d2-b992-e9c65311ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bade1f-7acd-4d2d-8221-54604aca0a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bade1f-7acd-4d2d-8221-54604aca0a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-502488351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e0d8fb-fc3c-48a7-958a-794b271cffff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7a98bc1a02475ca61fd75e8ac188c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:00Z,use_quota=True,user_id='74e45e5a9b3548fa86dcda8da2b88c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cf325a-4305-427b-a295-3e906cf3a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cf325a-4305-427b-a295-3e906cf3a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc56ca0b-10f5-4be2-9edd-c9ec7208063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc56ca0b-10f5-4be2-9edd-c9ec7208063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e0d8fb-fc3c-48a7-958a-794b271cffff', 'volume_name': 'volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa1a71c-bed8-41b2-82e9-f820663979b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa1a71c-bed8-41b2-82e9-f820663979b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa0a39-43b5-4d54-bc11-0a1899866d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Volume a9e0d8fb-fc3c-48a7-958a-794b271cffff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff', 'volume_size': 1} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-502488351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e0d8fb-fc3c-48a7-958a-794b271cffff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7a98bc1a02475ca61fd75e8ac188c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:00Z,use_quota=True,user_id='74e45e5a9b3548fa86dcda8da2b88c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Creating volume a9e0d8fb-fc3c-48a7-958a-794b271cffff {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:00 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff 1073741824 Sep 23 00:16:00 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:01 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff 1073741824" returned: 0 in 0.949s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:01 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff Sep 23 00:16:01 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:02 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa0a39-43b5-4d54-bc11-0a1899866d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e44fd1-44f4-42a6-aa42-bc9b82554346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Volume volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff (a9e0d8fb-fc3c-48a7-958a-794b271cffff): created successfully Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e44fd1-44f4-42a6-aa42-bc9b82554346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Flow 'volume_create_manager' (22fdd7b8-a58a-42d2-b992-e9c65311ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2e9d5b6-bf5d-41f5-9f48-018472a50f60 tempest-VolumesTransfersV357Test-1139781868 None] Created volume successfully. Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "cinder-a9e0d8fb-fc3c-48a7-958a-794b271cffff-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-a9e0d8fb-fc3c-48a7-958a-794b271cffff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "cinder-quobyte-a9e0d8fb-fc3c-48a7-958a-794b271cffff" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-quobyte-a9e0d8fb-fc3c-48a7-958a-794b271cffff" acquired by "delete_volume" :: waited 0.075s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf98e55-deb7-48c8-bb27-784bd1b2efa5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:03 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff Sep 23 00:16:03 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:04 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff" returned: 0 in 0.608s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:04 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff Sep 23 00:16:04 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:04 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a9e0d8fb-fc3c-48a7-958a-794b271cffff" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-quobyte-a9e0d8fb-fc3c-48a7-958a-794b271cffff" released by "delete_volume" :: held 1.229s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Created reservations ['da5bfcba-9ec7-4c85-98f6-0b3e22c051f0', '26f888c4-a8f2-4b7a-868c-ad97a836d02d', '8bf08d82-f891-42ef-b732-e6445ddeb92b', 'fe888a95-9d1c-4c8f-9099-1334de2cd442'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:05 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:05 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:05 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.670s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Deleted volume successfully. Sep 23 00:16:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9b072744-0153-43b7-8cfe-a322771f0281 tempest-VolumesTransfersV357Test-1063240955 None] Lock "cinder-a9e0d8fb-fc3c-48a7-958a-794b271cffff-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-32fd7632-aa01-4db5-bc95-8fbd3d6edecf tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-32fd7632-aa01-4db5-bc95-8fbd3d6edecf tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-32fd7632-aa01-4db5-bc95-8fbd3d6edecf tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-32fd7632-aa01-4db5-bc95-8fbd3d6edecf tempest-ServerActionsTestOtherA-1637709275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69814e99-037c-434e-8d46-3b44ce10bb8d', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-69bc42b8-ed90-4d04-adcd-b80a23989cad req-32fd7632-aa01-4db5-bc95-8fbd3d6edecf tempest-ServerActionsTestOtherA-1637709275 None] attachment_update completed successfully. Sep 23 00:16:16 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (f3048c8c-57d2-4596-ac0c-998e1055ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819db80e-5658-44b6-87a5-727b858d377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819db80e-5658-44b6-87a5-727b858d377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233909844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491152f5-f6e9-45db-9d98-cb8d0cdd65e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:26Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2d3970-d116-4375-8a58-085504523e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2d3970-d116-4375-8a58-085504523e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd22c8c-2963-436c-a8aa-0623989e4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd22c8c-2963-436c-a8aa-0623989e4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491152f5-f6e9-45db-9d98-cb8d0cdd65e3', 'volume_name': 'volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3a769-38dd-4955-827e-6cccbc9889cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3a769-38dd-4955-827e-6cccbc9889cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56bd93-a6b2-4c14-8746-1c2bed25b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Volume 491152f5-f6e9-45db-9d98-cb8d0cdd65e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3', 'volume_size': 1} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233909844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491152f5-f6e9-45db-9d98-cb8d0cdd65e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:26Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Creating volume 491152f5-f6e9-45db-9d98-cb8d0cdd65e3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 1073741824 Sep 23 00:16:26 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Flow 'volume_create_manager' (876a21c6-8b75-428d-960f-68651ddb0e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196da984-6b0f-45d6-a113-3d2897b43573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196da984-6b0f-45d6-a113-3d2897b43573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1594665179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6faee7-027a-468b-b677-032161478170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59842b1b2424241847c99aa5ca5c2f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:27Z,use_quota=True,user_id='9fee311e2b604bc8880ac0f4490ae06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d187c122-3d00-493d-aa28-c17be611f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d187c122-3d00-493d-aa28-c17be611f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c5ff4d-9da3-4227-8ce4-c6d4e0b15090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c5ff4d-9da3-4227-8ce4-c6d4e0b15090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6faee7-027a-468b-b677-032161478170', 'volume_name': 'volume-8a6faee7-027a-468b-b677-032161478170', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bd26a4-59fb-4147-8ac3-7712f1a998fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bd26a4-59fb-4147-8ac3-7712f1a998fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a678c066-1bb3-451a-ae3c-e1df64575db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Volume 8a6faee7-027a-468b-b677-032161478170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6faee7-027a-468b-b677-032161478170', 'volume_size': 2} Sep 23 00:16:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:28 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 1073741824" returned: 0 in 1.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 Sep 23 00:16:28 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1594665179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6faee7-027a-468b-b677-032161478170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59842b1b2424241847c99aa5ca5c2f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:27Z,use_quota=True,user_id='9fee311e2b604bc8880ac0f4490ae06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Creating volume 8a6faee7-027a-468b-b677-032161478170 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:28 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 2147483648 Sep 23 00:16:28 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56bd93-a6b2-4c14-8746-1c2bed25b444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a223401-1507-47b6-ab7c-694c2ed77f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Volume volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 (491152f5-f6e9-45db-9d98-cb8d0cdd65e3): created successfully Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a223401-1507-47b6-ab7c-694c2ed77f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (f3048c8c-57d2-4596-ac0c-998e1055ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9c225b71-ad90-4b4c-98ef-5cba5049edd7 tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b223b73b-8f91-4612-9bd4-62e0799c55e5 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b223b73b-8f91-4612-9bd4-62e0799c55e5 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" acquired by "attach_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b223b73b-8f91-4612-9bd4-62e0799c55e5 tempest-VolumesActionsTest-1982725737 None] Attaching volume 491152f5-f6e9-45db-9d98-cb8d0cdd65e3 to instance 146258c4-90e8-454a-b5a3-ce5067dad37e at mountpoint /dev/vdb on host None. Sep 23 00:16:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b223b73b-8f91-4612-9bd4-62e0799c55e5 tempest-VolumesActionsTest-1982725737 None] Attach volume completed successfully. Sep 23 00:16:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b223b73b-8f91-4612-9bd4-62e0799c55e5 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" released by "attach_volume" :: held 0.311s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:30 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 2147483648" returned: 0 in 1.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 Sep 23 00:16:30 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170" returned: 0 in 0.805s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a678c066-1bb3-451a-ae3c-e1df64575db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6faee7-027a-468b-b677-032161478170', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e44d10-e7f8-4957-bcc7-4fd55948a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Volume volume-8a6faee7-027a-468b-b677-032161478170 (8a6faee7-027a-468b-b677-032161478170): created successfully Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e44d10-e7f8-4957-bcc7-4fd55948a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Flow 'volume_create_manager' (876a21c6-8b75-428d-960f-68651ddb0e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ab0a200b-894d-4533-89fd-a531bfacc1e1 tempest-VolumesCloneNegativeTest-1798456179 None] Created volume successfully. Sep 23 00:16:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Terminate volume connection completed successfully. Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Detaching volume 491152f5-f6e9-45db-9d98-cb8d0cdd65e3 from instance 146258c4-90e8-454a-b5a3-ce5067dad37e. Sep 23 00:16:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Detach volume completed successfully. Sep 23 00:16:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-eb9ec29c-b017-4575-bbe1-208fd4905cce tempest-VolumesActionsTest-1248941977 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" released by "detach_volume" :: held 0.166s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e2940df6-42ae-4d7c-b8a6-f330d5b5c273 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e2940df6-42ae-4d7c-b8a6-f330d5b5c273 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e2940df6-42ae-4d7c-b8a6-f330d5b5c273 tempest-VolumesActionsTest-1982725737 None] Volume detach called, but volume not attached. Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e2940df6-42ae-4d7c-b8a6-f330d5b5c273 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-quobyte-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-quobyte-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699f750-9ffb-4ecd-a393-d558ba416982]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 Sep 23 00:16:33 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Acquiring lock "cinder-8a6faee7-027a-468b-b677-032161478170-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "cinder-8a6faee7-027a-468b-b677-032161478170-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Acquiring lock "cinder-quobyte-8a6faee7-027a-468b-b677-032161478170" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "cinder-quobyte-8a6faee7-027a-468b-b677-032161478170" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01433b48-639c-437c-88ce-495f2e97b976]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" returned: 0 in 1.147s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3 Sep 23 00:16:34 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 Sep 23 00:16:34 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" returned: 0 in 0.734s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-quobyte-491152f5-f6e9-45db-9d98-cb8d0cdd65e3" released by "delete_volume" :: held 1.961s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:35 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170" returned: 0 in 1.128s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Created reservations ['7a660652-12fc-4ede-8773-a4dc389ac98b', '925f1cc8-151a-46d2-8eb2-253f3929376a', '524d4f26-1100-4673-8a6b-056cefe84d96', '628ca7e3-9123-4e04-9a5c-4a744ea4f3e8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:35 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170 Sep 23 00:16:35 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:35 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8a6faee7-027a-468b-b677-032161478170" returned: 0 in 0.684s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "cinder-quobyte-8a6faee7-027a-468b-b677-032161478170" released by "delete_volume" :: held 1.980s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:35 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Deleted volume successfully. Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-032cdeb1-a22f-40aa-bdf8-792835119997 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-491152f5-f6e9-45db-9d98-cb8d0cdd65e3-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Created reservations ['84d5be9a-0e61-4ec3-9786-6c077bb08a53', '78109a26-3a58-46e6-a95f-b25a897215f4', '8af1096e-a413-4eef-8a92-e1112d855ba9', '37e46232-b0ef-40be-9ab3-601b38795483'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:36 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Deleted volume successfully. Sep 23 00:16:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d2a49f8-142c-44f8-80e8-a5785454c632 tempest-VolumesCloneNegativeTest-1798456179 None] Lock "cinder-8a6faee7-027a-468b-b677-032161478170-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (b5dba69d-5502-4e19-81c3-be55387a0072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965fe927-8132-4898-9ec1-847dc7d97ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965fe927-8132-4898-9ec1-847dc7d97ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1029207901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4009ca4-9441-4fb8-acf9-1f53e12fac3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:42Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d93738f-a5a3-453f-a5cd-bb9adac715dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d93738f-a5a3-453f-a5cd-bb9adac715dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26906781-9c44-4b80-86a4-25a8f26fd69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26906781-9c44-4b80-86a4-25a8f26fd69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4009ca4-9441-4fb8-acf9-1f53e12fac3a', 'volume_name': 'volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074af2cb-b633-4003-814b-14c804b4ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074af2cb-b633-4003-814b-14c804b4ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3d51b4-18b8-43aa-a6ce-6200e36d569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Volume d4009ca4-9441-4fb8-acf9-1f53e12fac3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a', 'volume_size': 1} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1029207901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4009ca4-9441-4fb8-acf9-1f53e12fac3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:42Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Creating volume d4009ca4-9441-4fb8-acf9-1f53e12fac3a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a 1073741824 Sep 23 00:16:42 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a 1073741824" returned: 0 in 0.787s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a Sep 23 00:16:43 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3d51b4-18b8-43aa-a6ce-6200e36d569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89f6055-e627-4664-ad7f-90a3586719a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Volume volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a (d4009ca4-9441-4fb8-acf9-1f53e12fac3a): created successfully Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89f6055-e627-4664-ad7f-90a3586719a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (b5dba69d-5502-4e19-81c3-be55387a0072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4650dcdc-40a1-4b61-a794-92c8efc827b8 tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-d4009ca4-9441-4fb8-acf9-1f53e12fac3a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-d4009ca4-9441-4fb8-acf9-1f53e12fac3a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-quobyte-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0343befc-f125-4e71-8299-130edc19903d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a Sep 23 00:16:45 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Flow 'volume_create_manager' (2f308333-b0c8-4232-ac1d-04b2cad0008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cef2fe-97f8-4d57-90b0-5b864936d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cef2fe-97f8-4d57-90b0-5b864936d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-951418593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cdb12-9b05-474f-b0e6-295d001cc249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb0a105622d405faf47348674bf6724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:45Z,use_quota=True,user_id='34487fa6309541b9a35d5b0607b19f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa54f249-bd17-4232-8c72-db78eac3c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa54f249-bd17-4232-8c72-db78eac3c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0953311d-3ed5-473c-83c4-63e14b8460ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:16:45 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" returned: 0 in 0.745s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a Sep 23 00:16:45 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:46 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-d4009ca4-9441-4fb8-acf9-1f53e12fac3a" released by "delete_volume" :: held 1.464s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0953311d-3ed5-473c-83c4-63e14b8460ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a16cdb12-9b05-474f-b0e6-295d001cc249', 'volume_name': 'volume-a16cdb12-9b05-474f-b0e6-295d001cc249', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7b9862-628a-4c3c-88c8-18d21022f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7b9862-628a-4c3c-88c8-18d21022f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104b3f3f-a958-4acb-8f45-a3c1dc23df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Volume a16cdb12-9b05-474f-b0e6-295d001cc249: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a16cdb12-9b05-474f-b0e6-295d001cc249', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Trying to clone a16cdb12-9b05-474f-b0e6-295d001cc249 from image 7ff22cbd-c151-45fd-8a05-f05c376811bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Created reservations ['e71520dd-4286-47e1-85df-d567a82146d7', 'adbb5fe8-eb9c-45f6-ba8e-0f5e404d7813', 'b80b0efe-0e7c-4f1a-9dd2-e3ebf66be5d3', 'a283f57c-0e14-49f5-b704-0b10f259cb65'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:46 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:46 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:16:47 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:16:47 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Deleted volume successfully. Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ad35bcdd-fa08-4f9a-b596-4cd203f79030 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-d4009ca4-9441-4fb8-acf9-1f53e12fac3a-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0febac4-5d32-40db-9475-fe2a491adde2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD Sep 23 00:16:47 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:48 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc is fetched for user 34487fa6309541b9a35d5b0607b19f7a. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:16:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-9e939baa-da26-4d49-b955-3f94c86c34dc tempest-ServerActionsTestOtherA-1637709275 None] Terminate volume connection completed successfully. Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-9e939baa-da26-4d49-b955-3f94c86c34dc tempest-ServerActionsTestOtherA-1637709275 None] Deleting attachment 69814e99-037c-434e-8d46-3b44ce10bb8d. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8895818e-7edc-4b5e-8027-453daefaafdc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (ea796aab-6c7c-4d55-b015-e6d5d3d702cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b4c85a-a274-48d8-ae7f-90806d875d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b4c85a-a274-48d8-ae7f-90806d875d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-905178085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fc6dab-433b-416b-838d-df3a3b1d7f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:49Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77015ad5-fb96-4401-8949-8763b9d4b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77015ad5-fb96-4401-8949-8763b9d4b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70376438-eb37-4d01-b380-b4bc6901174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70376438-eb37-4d01-b380-b4bc6901174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fc6dab-433b-416b-838d-df3a3b1d7f3e', 'volume_name': 'volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7784f301-cae0-4e0e-ad9a-64f18b635f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7784f301-cae0-4e0e-ad9a-64f18b635f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c861c57d-4ac4-4f3d-a559-d007b7bc9337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Volume b0fc6dab-433b-416b-838d-df3a3b1d7f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e', 'volume_size': 1} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-905178085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fc6dab-433b-416b-838d-df3a3b1d7f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:49Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Creating volume b0fc6dab-433b-416b-838d-df3a3b1d7f3e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:49 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD Sep 23 00:16:49 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e 1073741824 Sep 23 00:16:49 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "cinder-2f1062ed-d7c9-482e-9bc5-b00c973b6458-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-2f1062ed-d7c9-482e-9bc5-b00c973b6458-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "cinder-quobyte-2f1062ed-d7c9-482e-9bc5-b00c973b6458" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-quobyte-2f1062ed-d7c9-482e-9bc5-b00c973b6458" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffeac72-5327-487d-abf9-e629371ac9e2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 Sep 23 00:16:49 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:49 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e 1073741824" returned: 0 in 0.971s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458" returned: 0 in 0.632s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458 Sep 23 00:16:50 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e Sep 23 00:16:50 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "cinder-f22c1563-e4a4-4a72-9c3f-2da3bca5696c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-f22c1563-e4a4-4a72-9c3f-2da3bca5696c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "cinder-quobyte-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-quobyte-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-951418593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cdb12-9b05-474f-b0e6-295d001cc249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb0a105622d405faf47348674bf6724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:45Z,use_quota=True,user_id='34487fa6309541b9a35d5b0607b19f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Creating volume a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[817e748a-9b5d-49cd-9bd2-9f56e97c89b9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1073741824 Sep 23 00:16:50 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c861c57d-4ac4-4f3d-a559-d007b7bc9337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012a1f2-eca9-46c5-9591-bc1c3153873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2f1062ed-d7c9-482e-9bc5-b00c973b6458" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Volume volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e (b0fc6dab-433b-416b-838d-df3a3b1d7f3e): created successfully Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012a1f2-eca9-46c5-9591-bc1c3153873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (ea796aab-6c7c-4d55-b015-e6d5d3d702cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-quobyte-2f1062ed-d7c9-482e-9bc5-b00c973b6458" released by "delete_volume" :: held 1.190s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f1d00a2e-6f62-41fb-8feb-a4af75c083c9 tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:16:50 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c Sep 23 00:16:50 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.quota [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Created reservations ['dc3da9ff-e0b4-441f-9c93-370b518659ea', '416902c7-5b33-45e5-9724-33713befd860', 'dbcd29aa-a9ff-40cb-ae7a-58c912853fd5', 'c32f6669-f1d5-450a-ac9c-318ed0a237aa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:50 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c Sep 23 00:16:50 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1073741824" returned: 0 in 0.555s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.manager [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:51 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 Sep 23 00:16:51 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Deleted volume successfully. Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-883ef41d-b616-49b8-b71c-2ab3a4aeec36 req-76d29d70-2106-4064-9b3e-1bab3ce03ffb tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-2f1062ed-d7c9-482e-9bc5-b00c973b6458-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:51 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-quobyte-f22c1563-e4a4-4a72-9c3f-2da3bca5696c" released by "delete_volume" :: held 0.841s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Created reservations ['a19c9c98-1503-45a6-be55-e0fe9f71a694', '07d6f641-293d-4fc6-a9ec-330cc696bdc8', '3f4f7b34-11f0-4b88-af56-098864a527db', '5da35413-6b14-476e-85da-e74a3eb5d540'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:51 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Attempting download of 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume a16cdb12-9b05-474f-b0e6-295d001cc249. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:51 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d446a17-25c1-4863-a757-728ead9e61d6]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl Sep 23 00:16:51 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Deleted volume successfully. Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fa08e49c-9668-4d4f-bfff-03799cc314be tempest-ServerActionsTestOtherA-1637709275 None] Lock "cinder-f22c1563-e4a4-4a72-9c3f-2da3bca5696c-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:51 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-b0fc6dab-433b-416b-838d-df3a3b1d7f3e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-b0fc6dab-433b-416b-838d-df3a3b1d7f3e-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:52 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl Sep 23 00:16:52 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-quobyte-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc201b3-d30c-4944-8bde-2e56824cf409]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl" returned: 1 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_5v_rkswl' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6029f9b2-a204-4529-9ad8-b2313ad9f509]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e Sep 23 00:16:52 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD Sep 23 00:16:52 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e Sep 23 00:16:52 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] 7ff22cbd-c151-45fd-8a05-f05c376811bc was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:16:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 Sep 23 00:16:53 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-b0fc6dab-433b-416b-838d-df3a3b1d7f3e" released by "delete_volume" :: held 1.032s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Created reservations ['bf73b37d-42f8-44c8-9d0b-1bb3bd371cd4', '5ba7213c-703c-42c0-a619-15eeae8ef109', '31a71069-5981-4115-bcc8-bce7b80e75ba', '573e2fab-64cf-4264-8705-3b67b6163663'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:53 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:53 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:53 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Deleted volume successfully. Sep 23 00:16:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e715ce48-6b06-4430-a362-817d839f74d0 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-b0fc6dab-433b-416b-838d-df3a3b1d7f3e-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (222fc4ad-5ed2-4168-8c22-6cedfe594c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bdba7-9b65-4ef3-b150-c69daa246e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bdba7-9b65-4ef3-b150-c69daa246e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211970340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae582522-5f83-48e1-8112-38d44b9189cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:55Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda69acd-c2c0-4313-b429-7b32f0af0c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda69acd-c2c0-4313-b429-7b32f0af0c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cdd30a-1c25-4a69-9ba4-74b13b8aa53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cdd30a-1c25-4a69-9ba4-74b13b8aa53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae582522-5f83-48e1-8112-38d44b9189cc', 'volume_name': 'volume-ae582522-5f83-48e1-8112-38d44b9189cc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646ec293-0924-4185-a488-af9e458eab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646ec293-0924-4185-a488-af9e458eab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce6cc0a-09ca-4d17-88e0-7dd5aef10b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:55 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Volume ae582522-5f83-48e1-8112-38d44b9189cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae582522-5f83-48e1-8112-38d44b9189cc', 'volume_size': 1} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211970340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae582522-5f83-48e1-8112-38d44b9189cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:55Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Creating volume ae582522-5f83-48e1-8112-38d44b9189cc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:55 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc 1073741824 Sep 23 00:16:55 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:55 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249" returned: 0 in 2.702s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wd0u63pddevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:55 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Converted 112.00 MB image at 41.44 MB/s Sep 23 00:16:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:55 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1G Sep 23 00:16:55 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:56 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc 1073741824" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 1G" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Downloaded image 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume a16cdb12-9b05-474f-b0e6-295d001cc249 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc for user 34487fa6309541b9a35d5b0607b19f7a is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Marking volume a16cdb12-9b05-474f-b0e6-295d001cc249 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Copying metadata from image 7ff22cbd-c151-45fd-8a05-f05c376811bc to a16cdb12-9b05-474f-b0e6-295d001cc249. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Creating volume glance metadata for volume a16cdb12-9b05-474f-b0e6-295d001cc249 backed by image 7ff22cbd-c151-45fd-8a05-f05c376811bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:16:56 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc Sep 23 00:16:56 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104b3f3f-a958-4acb-8f45-a3c1dc23df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16cdb12-9b05-474f-b0e6-295d001cc249', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdaeef7-9969-41c5-92c9-43661116b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Volume volume-a16cdb12-9b05-474f-b0e6-295d001cc249 (a16cdb12-9b05-474f-b0e6-295d001cc249): created successfully Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdaeef7-9969-41c5-92c9-43661116b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Flow 'volume_create_manager' (2f308333-b0c8-4232-ac1d-04b2cad0008e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-73edb89a-018a-486d-9b3c-54463122a90e tempest-VolumesExtendTest-1369906468 None] Created volume successfully. Sep 23 00:16:56 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc" returned: 0 in 0.329s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce6cc0a-09ca-4d17-88e0-7dd5aef10b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae582522-5f83-48e1-8112-38d44b9189cc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f194220a-e875-4704-b25b-ae21b98c2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Volume volume-ae582522-5f83-48e1-8112-38d44b9189cc (ae582522-5f83-48e1-8112-38d44b9189cc): created successfully Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f194220a-e875-4704-b25b-ae21b98c2452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (222fc4ad-5ed2-4168-8c22-6cedfe594c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-13a2f33c-2920-4848-8fd4-c4729b6f0f26 tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab642de8-4027-49fe-85cd-493acaa650f2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:56 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 Sep 23 00:16:56 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 2G" returned: 0 in 0.139s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.578s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3d019378-9065-4251-9215-8fb72c072f05 tempest-VolumesExtendTest-1369906468 None] Extend volume completed successfully. Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-ae582522-5f83-48e1-8112-38d44b9189cc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "cinder-ae582522-5f83-48e1-8112-38d44b9189cc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-quobyte-ae582522-5f83-48e1-8112-38d44b9189cc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-ae582522-5f83-48e1-8112-38d44b9189cc" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4368f04-8dcf-4113-9c7d-2197e3921c6d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc Sep 23 00:16:58 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-a16cdb12-9b05-474f-b0e6-295d001cc249-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-a16cdb12-9b05-474f-b0e6-295d001cc249-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:58 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-quobyte-a16cdb12-9b05-474f-b0e6-295d001cc249" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:58 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc Sep 23 00:16:58 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-a16cdb12-9b05-474f-b0e6-295d001cc249" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f6dfd3-72a2-4dd4-b15a-3b73f339f770]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:58 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 Sep 23 00:16:58 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ae582522-5f83-48e1-8112-38d44b9189cc" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-ae582522-5f83-48e1-8112-38d44b9189cc" released by "delete_volume" :: held 1.333s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Created reservations ['67ccc965-a37e-4d27-b969-e8eaa7c46fc1', '62fd4dcb-1104-4e58-9805-635150a6744a', 'c06e4c48-e218-4844-8e73-39df963987a5', 'c1a98db5-cd99-4e07-8618-11dc9aefa20d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:59 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249" returned: 0 in 0.796s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:59 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:16:59 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249 Sep 23 00:16:59 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:59 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:59 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Deleted volume successfully. Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a16cdb12-9b05-474f-b0e6-295d001cc249" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-a16cdb12-9b05-474f-b0e6-295d001cc249" released by "delete_volume" :: held 1.300s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c2fb8550-de60-4d18-a552-57b492e68dda tempest-VolumesActionsTest-1248941977 None] Lock "cinder-ae582522-5f83-48e1-8112-38d44b9189cc-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Created reservations ['34c320e1-4fd1-4689-bac4-499bf1cbec2d', 'f736301b-8b54-4aa4-b5a8-552009ba9487', '38600804-f885-42d7-a883-bd4cf7c87b1f', '0d75beab-3f5a-4422-9341-fe0dc27643fc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:00 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:17:00 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:00 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Deleted volume successfully. Sep 23 00:17:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee939c68-6d2b-4827-9812-4510a6346cf8 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-a16cdb12-9b05-474f-b0e6-295d001cc249-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (7ee3107e-39f5-4fdc-a0dc-56236c41415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa3c7e4-ab4e-4b07-8ab7-be8135458aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa3c7e4-ab4e-4b07-8ab7-be8135458aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405479276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96003e2f-6c82-4b9a-9eb6-cb4641e991c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:01Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a526313d-47b6-49b3-8b87-9097fc1d77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a526313d-47b6-49b3-8b87-9097fc1d77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f5436-a832-4201-8c53-b40e4845e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f5436-a832-4201-8c53-b40e4845e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96003e2f-6c82-4b9a-9eb6-cb4641e991c0', 'volume_name': 'volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11706e5-93f4-48b5-a384-0371f24a4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11706e5-93f4-48b5-a384-0371f24a4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035ee2e7-5f41-451e-8e2c-6bd44a0c936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Volume 96003e2f-6c82-4b9a-9eb6-cb4641e991c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0', 'volume_size': 1} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405479276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96003e2f-6c82-4b9a-9eb6-cb4641e991c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:01Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Creating volume 96003e2f-6c82-4b9a-9eb6-cb4641e991c0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 1073741824 Sep 23 00:17:01 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (c2a1c736-7511-45d1-a506-0a69e1f5b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f225d86-fe91-48ed-9a8b-1f5cb3252e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f225d86-fe91-48ed-9a8b-1f5cb3252e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1481921132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4243a62e-e23f-4637-addc-68d289b828d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:02Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe66df6-c54d-468a-aa33-d42b7d0d9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe66df6-c54d-468a-aa33-d42b7d0d9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b3b15c-ab75-4c6f-9066-14a1fb5f67d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b3b15c-ab75-4c6f-9066-14a1fb5f67d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4243a62e-e23f-4637-addc-68d289b828d1', 'volume_name': 'volume-4243a62e-e23f-4637-addc-68d289b828d1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb1be9f-f2de-49b3-92fc-9fac5aee7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb1be9f-f2de-49b3-92fc-9fac5aee7140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c31383-56b4-4e56-9bb6-29fa998a6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Volume 4243a62e-e23f-4637-addc-68d289b828d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4243a62e-e23f-4637-addc-68d289b828d1', 'volume_size': 1} Sep 23 00:17:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:02 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Flow 'volume_create_manager' (656fb50e-48b3-4cd5-b49a-dece24d4fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872bdb8-fd77-4417-8dfd-0224839df88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 1073741824" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0872bdb8-fd77-4417-8dfd-0224839df88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-158351182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87796d96-73ef-4770-9815-5830f99018e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb0a105622d405faf47348674bf6724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:02Z,use_quota=True,user_id='34487fa6309541b9a35d5b0607b19f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a2c9b9-fb66-4acc-9f15-a1421c450bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a2c9b9-fb66-4acc-9f15-a1421c450bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c5824b-b32c-443c-8bdc-bb2e2e5ce89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c5824b-b32c-443c-8bdc-bb2e2e5ce89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87796d96-73ef-4770-9815-5830f99018e8', 'volume_name': 'volume-87796d96-73ef-4770-9815-5830f99018e8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788e68a-3474-49b6-bdb9-af54e3c254da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788e68a-3474-49b6-bdb9-af54e3c254da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4424df60-2885-4be1-ba01-7f2a22729d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Volume 87796d96-73ef-4770-9815-5830f99018e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87796d96-73ef-4770-9815-5830f99018e8', 'volume_size': 1} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 Sep 23 00:17:02 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1481921132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4243a62e-e23f-4637-addc-68d289b828d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:02Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Creating volume 4243a62e-e23f-4637-addc-68d289b828d1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035ee2e7-5f41-451e-8e2c-6bd44a0c936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 1073741824 Sep 23 00:17:02 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bedd03-f8f2-4213-8457-a09d484c0931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Volume volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 (96003e2f-6c82-4b9a-9eb6-cb4641e991c0): created successfully Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bedd03-f8f2-4213-8457-a09d484c0931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (7ee3107e-39f5-4fdc-a0dc-56236c41415d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-312870cb-723f-4b21-a5e4-b88af1c38fd9 tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:17:03 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 1073741824" returned: 0 in 0.725s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:03 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 Sep 23 00:17:03 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-96003e2f-6c82-4b9a-9eb6-cb4641e991c0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-96003e2f-6c82-4b9a-9eb6-cb4641e991c0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "cinder-quobyte-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6298af-138f-420b-aff9-19a87c0189b8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:04 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1" returned: 0 in 0.766s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-158351182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87796d96-73ef-4770-9815-5830f99018e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb0a105622d405faf47348674bf6724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:02Z,use_quota=True,user_id='34487fa6309541b9a35d5b0607b19f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Creating volume 87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:04 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 Sep 23 00:17:04 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:04 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 1073741824 Sep 23 00:17:04 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c31383-56b4-4e56-9bb6-29fa998a6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4243a62e-e23f-4637-addc-68d289b828d1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506eb0f9-39a0-4630-811a-d196f2e617ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Volume volume-4243a62e-e23f-4637-addc-68d289b828d1 (4243a62e-e23f-4637-addc-68d289b828d1): created successfully Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506eb0f9-39a0-4630-811a-d196f2e617ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (c2a1c736-7511-45d1-a506-0a69e1f5b1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-96f86164-27af-4dc6-a83a-7435f7c9b2ff tempest-AttachVolumeTestJSON-1274710783 None] Created volume successfully. Sep 23 00:17:04 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" returned: 0 in 0.808s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:04 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0 Sep 23 00:17:04 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:05 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 1073741824" returned: 0 in 0.667s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:05 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:05 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:05 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-quobyte-96003e2f-6c82-4b9a-9eb6-cb4641e991c0" released by "delete_volume" :: held 1.473s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Created reservations ['158d866e-5ba5-423a-9923-681f04c14bee', 'df99e0f0-1fe2-4da6-a720-783b3826e466', '29f53b0d-48c2-4c6a-83c3-406c7ceb2d10', 'ee80395c-7b93-45f1-b020-12aa673ec4ae'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:05 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4424df60-2885-4be1-ba01-7f2a22729d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87796d96-73ef-4770-9815-5830f99018e8', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8440d7-e560-4ee1-84e1-398efbfc6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Volume volume-87796d96-73ef-4770-9815-5830f99018e8 (87796d96-73ef-4770-9815-5830f99018e8): created successfully Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8440d7-e560-4ee1-84e1-398efbfc6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Flow 'volume_create_manager' (656fb50e-48b3-4cd5-b49a-dece24d4fec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b9692fa-9e7f-49e0-aa55-76ad1b4320fb tempest-VolumesExtendTest-1369906468 None] Created volume successfully. Sep 23 00:17:05 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:17:05 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:06 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Deleted volume successfully. Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58289f6f-ac0d-4347-8195-dbd7f6550f57 tempest-VolumesActionsTest-1248941977 None] Lock "cinder-96003e2f-6c82-4b9a-9eb6-cb4641e991c0-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7f9378aa-5e9e-4058-b777-8bf0c218a256 req-1451f8c4-bcf2-4b50-9e27-1d2e4add4122 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7f9378aa-5e9e-4058-b777-8bf0c218a256 req-1451f8c4-bcf2-4b50-9e27-1d2e4add4122 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-7f9378aa-5e9e-4058-b777-8bf0c218a256 req-1451f8c4-bcf2-4b50-9e27-1d2e4add4122 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-7f9378aa-5e9e-4058-b777-8bf0c218a256 req-1451f8c4-bcf2-4b50-9e27-1d2e4add4122 tempest-AttachVolumeTestJSON-1274710783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-4243a62e-e23f-4637-addc-68d289b828d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '091c8c72-a195-4aa4-8ce8-8f6cdc575d7c', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-7f9378aa-5e9e-4058-b777-8bf0c218a256 req-1451f8c4-bcf2-4b50-9e27-1d2e4add4122 tempest-AttachVolumeTestJSON-1274710783 None] attachment_update completed successfully. Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (18cf7cc4-74a8-4145-8241-46b337387b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e4860f-3b02-4c26-8bf5-390754774638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Creating offline snapshot 4cd39f2e-267c-4639-a4c7-6938f881c49e of volume 87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e3c5a-afac-49ea-8e4f-63a4b627f43e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e4860f-3b02-4c26-8bf5-390754774638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740031757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:07Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44936451-db30-4109-8a5c-841e7ecc1857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44936451-db30-4109-8a5c-841e7ecc1857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660e275c-734e-4a84-89cc-7f75f5543692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660e275c-734e-4a84-89cc-7f75f5543692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae', 'volume_name': 'volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c4f5da-0b07-4b7b-aaa0-eab86a62f79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c4f5da-0b07-4b7b-aaa0-eab86a62f79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2760d5-e084-4300-b86e-2ffa9b09c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Volume 5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae', 'volume_size': 1} Sep 23 00:17:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:07 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:07 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:08 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.590s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:08 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e 1G Sep 23 00:17:08 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e 1G" returned: 0 in 0.930s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87796d96-73ef-4770-9815-5830f99018e8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87796d96-73ef-4770-9815-5830f99018e8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e Sep 23 00:17:09 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87796d96-73ef-4770-9815-5830f99018e8 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e" returned: 0 in 0.591s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e is being set with open permissions: ugo+rw Sep 23 00:17:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e Sep 23 00:17:09 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e" returned: 0 in 0.420s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info Sep 23 00:17:10 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info" returned: 0 in 0.331s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info is being set with open permissions: ugo+rw Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info Sep 23 00:17:10 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.info" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.189s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740031757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9214ab8e697d4e5fa8dbf98f566fd5cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:07Z,use_quota=True,user_id='577b57def66241cda15938576b9f1dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Creating volume 5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:17:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae 1073741824 Sep 23 00:17:10 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f9d6e7dc-87dc-4567-bc24-59b416bbff99 tempest-VolumesExtendTest-1369906468 None] Create snapshot completed successfully Sep 23 00:17:11 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae 1073741824" returned: 0 in 0.858s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:11 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae Sep 23 00:17:11 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:12 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" returned: 0 in 0.343s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.319s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2760d5-e084-4300-b86e-2ffa9b09c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fccaa8c-348b-4fd8-98a9-16f8ae6019ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f41299-16d2-4235-a1a6-4e9d402c8c70]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Volume volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae (5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae): created successfully Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fccaa8c-348b-4fd8-98a9-16f8ae6019ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Flow 'volume_create_manager' (18cf7cc4-74a8-4145-8241-46b337387b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b4c1ac9-b595-497f-825a-f9d6fc91efaf tempest-VolumesActionsTest-1982725737 None] Created volume successfully. Sep 23 00:17:12 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:12 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:12 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.739s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e 2G" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.163s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8369820e-dac4-4d1b-a0a0-58000b4e23bc tempest-VolumesExtendTest-1369906468 None] Extend volume completed successfully. Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "cinder-quobyte-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-quobyte-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d2dfe-54b3-4d3e-89c0-ee51e48d7c68]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-4cd39f2e-267c-4639-a4c7-6938f881c49e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae Sep 23 00:17:14 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-4cd39f2e-267c-4639-a4c7-6938f881c49e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-quobyte-4cd39f2e-267c-4639-a4c7-6938f881c49e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-4cd39f2e-267c-4639-a4c7-6938f881c49e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Deleting offline snapshot 4cd39f2e-267c-4639-a4c7-6938f881c49e of volume 87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] snapshot_file for this snap is: volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf6fd3-a63c-4ca6-83f6-d416266a9afa]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e Sep 23 00:17:15 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" returned: 0 in 0.949s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae Sep 23 00:17:15 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e" returned: 0 in 0.996s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87796d96-73ef-4770-9815-5830f99018e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c766006-b108-4557-87ab-11260b3326e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" returned: 0 in 0.709s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:15 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-quobyte-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae" released by "delete_volume" :: held 1.771s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Created reservations ['e5ccb7e5-d3f9-4dad-98ff-a83e018b08f3', 'bb94b801-1822-48c9-9c61-752045518c48', '54dbe6b4-437a-4ec3-969b-d99f236f9259', '0930934b-3870-4b24-9077-3c2c185ff1c2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=95,cinder:UPDATE=122,cinder:DELETE=9,cinder:INSERT=34 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:17:16 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.983s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e Sep 23 00:17:16 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Deleted volume successfully. Sep 23 00:17:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-46b52b93-a2ca-4846-a3b1-d2fba0170282 tempest-VolumesActionsTest-1982725737 None] Lock "cinder-5f8f0619-2d6a-47d2-bebc-5d2e03bdb3ae-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:17 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e" returned: 0 in 1.215s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e Sep 23 00:17:18 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8.4cd39f2e-267c-4639-a4c7-6938f881c49e" returned: 0 in 0.579s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-4cd39f2e-267c-4639-a4c7-6938f881c49e" released by "_delete_snapshot" :: held 4.034s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" released by "delete_snapshot" :: held 4.092s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Created reservations ['e3dff91b-3223-4260-91cc-940105c27487', 'd303add8-ed33-4c9d-8c37-cbdc5ae9f840', 'a6cfc9fc-f069-4265-8249-c311003a74bc', 'a0c0efcb-bd23-449d-a682-e6c6ba2b5772'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=109,cinder:UPDATE=130,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Delete snapshot completed successfully. Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-17e2f7ac-4750-4f39-a972-89b89015505d tempest-VolumesExtendTest-1369906468 None] Lock "cinder-4cd39f2e-267c-4639-a4c7-6938f881c49e-delete_snapshot" released by "delete_snapshot" :: held 4.491s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-87796d96-73ef-4770-9815-5830f99018e8-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-87796d96-73ef-4770-9815-5830f99018e8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3e43b-b8c9-405b-9567-f83eb737f5e6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:20 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.869s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8 Sep 23 00:17:20 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-87796d96-73ef-4770-9815-5830f99018e8" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-quobyte-87796d96-73ef-4770-9815-5830f99018e8" released by "delete_volume" :: held 1.516s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Created reservations ['e1921d20-f154-4754-ac22-a4e4239d74a4', '0dd332f3-8248-42d6-b438-ae3b22e0892f', '44b13a8f-7c0c-448d-9bc8-fa2079a40e9f', '640e33ab-3088-47ae-ba8b-ab673018b81d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:17:21 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.830s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Deleted volume successfully. Sep 23 00:17:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3a931add-cdc3-4f43-8394-62d7ee1b20f1 tempest-VolumesExtendTest-1369906468 None] Lock "cinder-87796d96-73ef-4770-9815-5830f99018e8-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Flow 'volume_create_manager' (469145c7-5bc9-4d79-ad49-d6676114a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3786842-b56f-4bbb-8a18-0e0ece45fd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3786842-b56f-4bbb-8a18-0e0ece45fd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-951352912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbe755c-5dec-4ebc-96ab-9c349307b10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d186f52eeb74dc0b91f484c797097eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:31Z,use_quota=True,user_id='1fb334b84b954226a5081b061212981b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee46e69-284d-44fa-9add-d452235a8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee46e69-284d-44fa-9add-d452235a8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f10776d-792a-4710-bf06-578fcce08909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f10776d-792a-4710-bf06-578fcce08909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbe755c-5dec-4ebc-96ab-9c349307b10a', 'volume_name': 'volume-abbe755c-5dec-4ebc-96ab-9c349307b10a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21dc410-20d9-46bf-baea-c25ff9f1632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21dc410-20d9-46bf-baea-c25ff9f1632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c824ed8b-e1c3-4808-a1e7-9782d253e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Volume abbe755c-5dec-4ebc-96ab-9c349307b10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbe755c-5dec-4ebc-96ab-9c349307b10a', 'volume_size': 1} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-951352912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbe755c-5dec-4ebc-96ab-9c349307b10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d186f52eeb74dc0b91f484c797097eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:31Z,use_quota=True,user_id='1fb334b84b954226a5081b061212981b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Creating volume abbe755c-5dec-4ebc-96ab-9c349307b10a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:17:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:31 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a 1073741824 Sep 23 00:17:31 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:32 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a 1073741824" returned: 0 in 0.788s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:32 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a Sep 23 00:17:32 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:32 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c824ed8b-e1c3-4808-a1e7-9782d253e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbe755c-5dec-4ebc-96ab-9c349307b10a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f772d730-ad17-4ee8-8fa8-68ad5a449776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Volume volume-abbe755c-5dec-4ebc-96ab-9c349307b10a (abbe755c-5dec-4ebc-96ab-9c349307b10a): created successfully Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f772d730-ad17-4ee8-8fa8-68ad5a449776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Flow 'volume_create_manager' (469145c7-5bc9-4d79-ad49-d6676114a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f6c0f93b-2657-45a2-8fe2-190d86d9778c tempest-VolumesNegativeTest-1627530754 None] Created volume successfully. Sep 23 00:17:42 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=17 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:42 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-93bdc0cd-0330-43ce-8933-a3d95fb95d10 req-65a6d753-b503-4d15-ad19-412bac60a3b6 tempest-AttachVolumeTestJSON-1274710783 None] Terminate volume connection completed successfully. Sep 23 00:17:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-93bdc0cd-0330-43ce-8933-a3d95fb95d10 req-65a6d753-b503-4d15-ad19-412bac60a3b6 tempest-AttachVolumeTestJSON-1274710783 None] Deleting attachment 091c8c72-a195-4aa4-8ce8-8f6cdc575d7c. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:49 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:17:49 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:51 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 1.235s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:51 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:17:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:17:57 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:57 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Flow 'volume_create_manager' (df4e9320-62ec-4693-8e4b-c19e45b04a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c9226-0dc6-42a5-b2a5-c14458d439ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c9226-0dc6-42a5-b2a5-c14458d439ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-29989134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708df3fb-b7cd-4e0a-a68a-d2101978ee46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ebee650d0841e5ae3a4cf409fb1119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:06Z,use_quota=True,user_id='66d4256efdcc4560b72cf34e538bbe80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd5d580-c16a-4855-b52b-3126ed2563b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd5d580-c16a-4855-b52b-3126ed2563b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa173d-aa53-47c7-ae7a-744c32543139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caa173d-aa53-47c7-ae7a-744c32543139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708df3fb-b7cd-4e0a-a68a-d2101978ee46', 'volume_name': 'volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c55710c-cfcb-4dc6-8c61-3d7333bd2186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c55710c-cfcb-4dc6-8c61-3d7333bd2186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1a1260-6873-483a-a7bc-c7970b8c264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Volume 708df3fb-b7cd-4e0a-a68a-d2101978ee46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46', 'volume_size': 1} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-29989134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708df3fb-b7cd-4e0a-a68a-d2101978ee46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ebee650d0841e5ae3a4cf409fb1119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:06Z,use_quota=True,user_id='66d4256efdcc4560b72cf34e538bbe80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Creating volume 708df3fb-b7cd-4e0a-a68a-d2101978ee46 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:18:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:06 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 1073741824 Sep 23 00:18:06 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 1073741824" returned: 0 in 2.177s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:08 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 Sep 23 00:18:08 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46" returned: 0 in 0.922s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] <== create_volume: return (3228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.231s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1a1260-6873-483a-a7bc-c7970b8c264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03bc863-25f0-4c4b-a67b-ee7cc6f6b622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Volume volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 (708df3fb-b7cd-4e0a-a68a-d2101978ee46): created successfully Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03bc863-25f0-4c4b-a67b-ee7cc6f6b622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Flow 'volume_create_manager' (df4e9320-62ec-4693-8e4b-c19e45b04a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ba76ea1e-7fa5-4623-ba5c-51ac737ad3ac tempest-ServerRescueNegativeTestJSON-1343527278 None] Created volume successfully. Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Flow 'volume_create_manager' (861466a0-454b-47fb-af36-0c41dd014463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce56047-334e-4165-beb3-598699ecc892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce56047-334e-4165-beb3-598699ecc892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1754995509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d684837-00f0-47ba-a66d-cd73dda5766f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a47462035074e4fb0642c976782c125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:10Z,use_quota=True,user_id='ac301b6e25fd4721b3732c1891a8ba84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377f6a41-63b2-4def-a8b1-548638f9ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377f6a41-63b2-4def-a8b1-548638f9ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf322de-b09a-4a12-9f11-7de6b4c36eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:10 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf322de-b09a-4a12-9f11-7de6b4c36eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d684837-00f0-47ba-a66d-cd73dda5766f', 'volume_name': 'volume-4d684837-00f0-47ba-a66d-cd73dda5766f', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2443feaa-a004-40f9-9d19-d3b98fcb4b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2443feaa-a004-40f9-9d19-d3b98fcb4b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ba447-c4fd-4539-b8eb-ab7388669611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Volume 4d684837-00f0-47ba-a66d-cd73dda5766f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d684837-00f0-47ba-a66d-cd73dda5766f', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:18:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Trying to clone 4d684837-00f0-47ba-a66d-cd73dda5766f from image 7ff22cbd-c151-45fd-8a05-f05c376811bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:18:12 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD, size 20.69 MB, duration 1.19 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:18:12 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Image download 20.69 MB at 17.32 MB/s Sep 23 00:18:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b116533-e853-4707-9b25-b4b8b1e39d86]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:12 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD Sep 23 00:18:12 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:13 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD" returned: 0 in 0.897s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:13 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc is fetched for user ac301b6e25fd4721b3732c1891a8ba84. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:18:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32dd6f8-0a58-4b32-83d3-98e48f195b8f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:13 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD Sep 23 00:18:13 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:14 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1754995509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d684837-00f0-47ba-a66d-cd73dda5766f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a47462035074e4fb0642c976782c125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:10Z,use_quota=True,user_id='ac301b6e25fd4721b3732c1891a8ba84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Creating volume 4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:18:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:14 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1073741824 Sep 23 00:18:14 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:15 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1073741824" returned: 0 in 1.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:15 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f Sep 23 00:18:15 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:16 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f" returned: 0 in 0.740s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Attempting download of 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 4d684837-00f0-47ba-a66d-cd73dda5766f. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c42d8-aa7a-4f6b-b5ab-cceeeb1d06f7]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u Sep 23 00:18:16 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:17 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u" returned: 0 in 0.883s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:17 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u Sep 23 00:18:17 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:18 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u" returned: 1 in 1.064s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_1ci5f22u' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:18:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d81b853-92c7-4b3a-b6b7-a4b01a26c5f7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:18 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD Sep 23 00:18:18 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:19 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:19 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] 7ff22cbd-c151-45fd-8a05-f05c376811bc was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:18:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:19 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f Sep 23 00:18:19 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:23 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f" returned: 0 in 4.247s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:23 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_wzrujp99devstack@QuobyteHD, size 112.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:18:23 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Converted 112.00 MB image at 26.36 MB/s Sep 23 00:18:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:23 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1G Sep 23 00:18:23 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:24 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f 1G" returned: 0 in 0.650s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Downloaded image 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 4d684837-00f0-47ba-a66d-cd73dda5766f successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc for user ac301b6e25fd4721b3732c1891a8ba84 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Marking volume 4d684837-00f0-47ba-a66d-cd73dda5766f as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Copying metadata from image 7ff22cbd-c151-45fd-8a05-f05c376811bc to 4d684837-00f0-47ba-a66d-cd73dda5766f. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Creating volume glance metadata for volume 4d684837-00f0-47ba-a66d-cd73dda5766f backed by image 7ff22cbd-c151-45fd-8a05-f05c376811bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ba447-c4fd-4539-b8eb-ab7388669611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d684837-00f0-47ba-a66d-cd73dda5766f', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519b6b4-7b79-4c2b-a0a8-55e055d2b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Volume volume-4d684837-00f0-47ba-a66d-cd73dda5766f (4d684837-00f0-47ba-a66d-cd73dda5766f): created successfully Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519b6b4-7b79-4c2b-a0a8-55e055d2b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Flow 'volume_create_manager' (861466a0-454b-47fb-af36-0c41dd014463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8617dae3-2843-460f-a10b-948195442f96 tempest-VolumesImageMetadata-656608846 None] Created volume successfully. Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Acquiring lock "cinder-abbe755c-5dec-4ebc-96ab-9c349307b10a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "cinder-abbe755c-5dec-4ebc-96ab-9c349307b10a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Acquiring lock "cinder-quobyte-abbe755c-5dec-4ebc-96ab-9c349307b10a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "cinder-quobyte-abbe755c-5dec-4ebc-96ab-9c349307b10a" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b005c632-c384-4de3-8c7e-bd37ae3e97be]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:24 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a Sep 23 00:18:24 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:25 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:25 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a Sep 23 00:18:25 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Acquiring lock "cinder-4d684837-00f0-47ba-a66d-cd73dda5766f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "cinder-4d684837-00f0-47ba-a66d-cd73dda5766f-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:25 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-abbe755c-5dec-4ebc-96ab-9c349307b10a" returned: 0 in 0.559s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "cinder-quobyte-abbe755c-5dec-4ebc-96ab-9c349307b10a" released by "delete_volume" :: held 1.109s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Acquiring lock "cinder-quobyte-4d684837-00f0-47ba-a66d-cd73dda5766f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "cinder-quobyte-4d684837-00f0-47ba-a66d-cd73dda5766f" acquired by "delete_volume" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Acquiring lock "cinder-708df3fb-b7cd-4e0a-a68a-d2101978ee46-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c1492-a288-44a9-9b94-be487e30c458]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "cinder-708df3fb-b7cd-4e0a-a68a-d2101978ee46-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Created reservations ['1e9369eb-3617-480d-8979-f3371ccc05fa', '9010c3b0-de27-420a-8d34-cd71f539d31a', '0166d365-bf42-427e-bacb-08841643a3a3', '68ffadd4-2e9a-46f1-a768-895a87fcc76e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Acquiring lock "cinder-quobyte-708df3fb-b7cd-4e0a-a68a-d2101978ee46" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "cinder-quobyte-708df3fb-b7cd-4e0a-a68a-d2101978ee46" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:26 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f Sep 23 00:18:26 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[869ea9a9-cb6a-4707-9409-775b1d6ec0fd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:18:26 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:26 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 Sep 23 00:18:26 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:26 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f Sep 23 00:18:26 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:26 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.571s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Deleted volume successfully. Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7bae2c5-ca50-48a9-8a49-0b0230aadcd0 tempest-VolumesNegativeTest-1627530754 None] Lock "cinder-abbe755c-5dec-4ebc-96ab-9c349307b10a-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:27 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46" returned: 0 in 0.745s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46 Sep 23 00:18:27 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d684837-00f0-47ba-a66d-cd73dda5766f" returned: 0 in 0.706s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "cinder-quobyte-4d684837-00f0-47ba-a66d-cd73dda5766f" released by "delete_volume" :: held 1.425s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Created reservations ['11b1481c-9485-4249-b9d3-8cd6612468bb', 'c1b126c5-1aed-45cb-8603-4cabeff4c81e', 'e53662cf-0446-4ed6-b609-eff09204e421', '70a1a278-9f1c-46f2-a5f6-12a3e2802f5b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:27 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-708df3fb-b7cd-4e0a-a68a-d2101978ee46" returned: 0 in 0.540s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "cinder-quobyte-708df3fb-b7cd-4e0a-a68a-d2101978ee46" released by "delete_volume" :: held 1.376s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Created reservations ['5f24e4ff-99cf-4c93-925e-a1d7b8b3a212', '1bb4e86b-f29a-49c9-bb4d-ef1c1203c3f1', 'bc3c391b-1b81-4a5b-9d3f-1c1f64c72eb2', '8eed01f8-d0e2-465a-ae2b-8c828bd21471'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:27 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:18:27 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:18:27 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Deleted volume successfully. Sep 23 00:18:28 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Deleted volume successfully. Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f97a36-911f-4ba7-a545-9e504114e925 tempest-VolumesImageMetadata-656608846 None] Lock "cinder-4d684837-00f0-47ba-a66d-cd73dda5766f-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5f83d709-9694-4a2d-8fd1-8403ea02c8da tempest-ServerRescueNegativeTestJSON-1343527278 None] Lock "cinder-708df3fb-b7cd-4e0a-a68a-d2101978ee46-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Flow 'volume_create_manager' (d07d4b90-8403-4401-b071-55ea8c8d2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cdff65-fb54-4e2d-91bd-519c18ee7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cdff65-fb54-4e2d-91bd-519c18ee7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1922665730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63378bb0-11f6-40f5-a322-fd785f319a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5523267d5dba461c8cb399190823343b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:36Z,use_quota=True,user_id='a4a9e030ee73466ea20e487219f1c8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f75dfc-201c-4115-92c5-6b3062d713ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f75dfc-201c-4115-92c5-6b3062d713ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9709621-e21b-429c-8910-93bcf71e426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9709621-e21b-429c-8910-93bcf71e426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63378bb0-11f6-40f5-a322-fd785f319a64', 'volume_name': 'volume-63378bb0-11f6-40f5-a322-fd785f319a64', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef08b23f-6759-46e5-8f9d-c93054bd3df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef08b23f-6759-46e5-8f9d-c93054bd3df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c629614f-31c0-4829-bb06-5f5a85c3ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Volume 63378bb0-11f6-40f5-a322-fd785f319a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63378bb0-11f6-40f5-a322-fd785f319a64', 'volume_size': 2} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1922665730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63378bb0-11f6-40f5-a322-fd785f319a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5523267d5dba461c8cb399190823343b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:36Z,use_quota=True,user_id='a4a9e030ee73466ea20e487219f1c8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Creating volume 63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:18:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 2147483648 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:36 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 2147483648 Sep 23 00:18:36 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (7393fef2-e744-4c92-9cdd-105a020e4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0698b7ff-f642-4b90-91d5-e68d647ce8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0698b7ff-f642-4b90-91d5-e68d647ce8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1616276018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0414b8db-a373-4416-ae9b-4212ed6ddb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e360a546fb4f4801b5717390d1355334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:38Z,use_quota=True,user_id='4d1c7d03faa64a59bcc2711cd879a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96d83d-fdfb-4440-b655-9bed694ef42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96d83d-fdfb-4440-b655-9bed694ef42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc36af9-a147-4882-928d-bcfe146aec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc36af9-a147-4882-928d-bcfe146aec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0414b8db-a373-4416-ae9b-4212ed6ddb0c', 'volume_name': 'volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e603e-0dd6-4df7-ac73-9c2eed4a25ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046e603e-0dd6-4df7-ac73-9c2eed4a25ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3968f2e-baf0-41f3-82bb-fa94f607d244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c', 'volume_size': 1} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 2147483648" returned: 0 in 1.613s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:38 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 Sep 23 00:18:38 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:39 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64" returned: 0 in 0.589s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1616276018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0414b8db-a373-4416-ae9b-4212ed6ddb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e360a546fb4f4801b5717390d1355334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:38Z,use_quota=True,user_id='4d1c7d03faa64a59bcc2711cd879a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Creating volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c629614f-31c0-4829-bb06-5f5a85c3ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63378bb0-11f6-40f5-a322-fd785f319a64', 'volume_size': 2}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:39 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c 1073741824 Sep 23 00:18:39 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dafbc2f-23b2-474a-81ef-ab6e972afdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Volume volume-63378bb0-11f6-40f5-a322-fd785f319a64 (63378bb0-11f6-40f5-a322-fd785f319a64): created successfully Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dafbc2f-23b2-474a-81ef-ab6e972afdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Flow 'volume_create_manager' (d07d4b90-8403-4401-b071-55ea8c8d2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-76bc3950-1ca2-4337-8bc1-0b289e1fe5f1 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Created volume successfully. Sep 23 00:18:40 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c 1073741824" returned: 0 in 1.143s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:40 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c Sep 23 00:18:40 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:40 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.563s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Creating offline snapshot ca5470c6-c23e-4812-b46d-2fdfafd77c47 of volume 63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3968f2e-baf0-41f3-82bb-fa94f607d244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dcd859-f83f-4f79-a3fe-ac834adaee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee9fdc-0191-44ed-abc9-5afa60519dfb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Volume volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c (0414b8db-a373-4416-ae9b-4212ed6ddb0c): created successfully Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dcd859-f83f-4f79-a3fe-ac834adaee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (7393fef2-e744-4c92-9cdd-105a020e4046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75c8bc50-3fdf-40b0-9c9f-24830beb9f29 tempest-VolumesDeleteCascade-1913570724 None] Created volume successfully. Sep 23 00:18:41 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 Sep 23 00:18:41 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64" returned: 0 in 0.727s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 2G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:41 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 2G Sep 23 00:18:41 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:42 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 2G" returned: 0 in 0.804s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63378bb0-11f6-40f5-a322-fd785f319a64 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:42 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63378bb0-11f6-40f5-a322-fd785f319a64 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 Sep 23 00:18:42 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:42 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63378bb0-11f6-40f5-a322-fd785f319a64 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 is being set with open permissions: ugo+rw Sep 23 00:18:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:42 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 Sep 23 00:18:42 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info Sep 23 00:18:43 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info is being set with open permissions: ugo+rw Sep 23 00:18:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info Sep 23 00:18:43 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.info" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.506s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.674s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Creating offline snapshot 8f868116-5b0f-4c53-b4d3-8980770cdcb5 of volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-22e66666-ea2f-479b-a3c0-3f41a9fe7923 tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Create snapshot completed successfully Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf592d-97de-4f03-bc42-a7beb7528ef3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:44 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c Sep 23 00:18:44 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "cinder-ca5470c6-c23e-4812-b46d-2fdfafd77c47-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-ca5470c6-c23e-4812-b46d-2fdfafd77c47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "cinder-quobyte-ca5470c6-c23e-4812-b46d-2fdfafd77c47" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-ca5470c6-c23e-4812-b46d-2fdfafd77c47" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Deleting offline snapshot ca5470c6-c23e-4812-b46d-2fdfafd77c47 of volume 63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] snapshot_file for this snap is: volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09da4b-3c0c-4d3a-b658-2e9a533b60f8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c" returned: 0 in 0.725s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 1G Sep 23 00:18:45 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 Sep 23 00:18:45 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47" returned: 0 in 0.622s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63378bb0-11f6-40f5-a322-fd785f319a64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4594a-bd8d-41f0-a4c1-5e0939e2700e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 1G" returned: 0 in 0.669s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:45 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 Sep 23 00:18:45 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64" returned: 0 in 0.693s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 Sep 23 00:18:46 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.762s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 is being set with open permissions: ugo+rw Sep 23 00:18:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:46 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47" returned: 0 in 0.683s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47 Sep 23 00:18:47 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info Sep 23 00:18:47 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64.ca5470c6-c23e-4812-b46d-2fdfafd77c47" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-ca5470c6-c23e-4812-b46d-2fdfafd77c47" released by "_delete_snapshot" :: held 2.626s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" released by "delete_snapshot" :: held 2.674s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:47 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info" returned: 0 in 0.501s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info is being set with open permissions: ugo+rw Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info Sep 23 00:18:47 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Created reservations ['b918d3a8-8ea5-4a6f-bb45-c33249ed13f0', 'd2b637f4-af3b-4f77-ac35-c8262a6e79cc', '1b885fcb-bab4-4855-989b-47b2c349c618', 'b87d4217-2b9d-4111-b0c4-58293109800f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Delete snapshot completed successfully. Sep 23 00:18:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3dd0290-6b5f-4a64-be8f-c46c76f56d0b tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-ca5470c6-c23e-4812-b46d-2fdfafd77c47-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:48 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.info" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.873s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c5390ee0-e0fd-4589-998a-90dc0d4a529b tempest-VolumesDeleteCascade-1913570724 None] Create snapshot completed successfully Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "cinder-63378bb0-11f6-40f5-a322-fd785f319a64-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-63378bb0-11f6-40f5-a322-fd785f319a64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee30dad-5ad8-4115-b7e3-64f4fb7b941e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 Sep 23 00:18:48 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64 Sep 23 00:18:49 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Creating offline snapshot 4c5186ec-f736-4079-b345-a40ed6b273dc of volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:49 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63378bb0-11f6-40f5-a322-fd785f319a64" returned: 0 in 0.542s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbafea0a-131d-47a7-9d8e-457a89e72a31]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-quobyte-63378bb0-11f6-40f5-a322-fd785f319a64" released by "delete_volume" :: held 1.288s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Created reservations ['de0887d6-9705-42b9-bbfb-ef280b849f26', '6587cb75-0df7-4057-ae22-1c67c266bbe4', 'cf4d7491-3d2f-4e77-b4b3-3b7627a61578', 'e98b1284-fab4-4aeb-b1a5-c3f1ccc5fda5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:49 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:18:49 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:18:50 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.687s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:50 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc 1G Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:50 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.723s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Deleted volume successfully. Sep 23 00:18:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4588b397-e333-4143-b3cd-c43a3a3d340e tempest-VolumesSnapshotNegativeTestJSON-72723055 None] Lock "cinder-63378bb0-11f6-40f5-a322-fd785f319a64-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:51 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc 1G" returned: 0 in 0.930s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc Sep 23 00:18:51 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc is being set with open permissions: ugo+rw Sep 23 00:18:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc Sep 23 00:18:51 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-56d81624-7786-48eb-9321-23a0b0edc251 tempest-VolumesDeleteCascade-1913570724 None] Create snapshot completed successfully Sep 23 00:18:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-0414b8db-a373-4416-ae9b-4212ed6ddb0c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-0414b8db-a373-4416-ae9b-4212ed6ddb0c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-4c5186ec-f736-4079-b345-a40ed6b273dc-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-4c5186ec-f736-4079-b345-a40ed6b273dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-4c5186ec-f736-4079-b345-a40ed6b273dc" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4c5186ec-f736-4079-b345-a40ed6b273dc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Deleting offline snapshot 4c5186ec-f736-4079-b345-a40ed6b273dc of volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] snapshot_file for this snap is: volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[65892532-7e64-4ddd-ba4a-6af0c29a76fd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc Sep 23 00:18:53 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc" returned: 0 in 0.692s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2205ec5-ba5e-446a-b1c6-0d887a27066e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:54 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:54 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:54 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:54 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc Sep 23 00:18:54 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc" returned: 0 in 0.607s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:55 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc Sep 23 00:18:55 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.4c5186ec-f736-4079-b345-a40ed6b273dc" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4c5186ec-f736-4079-b345-a40ed6b273dc" released by "_delete_snapshot" :: held 2.378s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" released by "delete_snapshot" :: held 2.431s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['7b2e47ee-18b4-442f-83e1-847a51900cf3', 'dbdccaf1-57ef-489c-b157-c84f1c36a754', 'fb90195a-295f-4b91-82ba-ba172c4b69a8', '957a9c51-dbac-4370-9b03-c3e8eb1b3353'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Delete snapshot completed successfully. Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-4c5186ec-f736-4079-b345-a40ed6b273dc-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-8f868116-5b0f-4c53-b4d3-8980770cdcb5-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-8f868116-5b0f-4c53-b4d3-8980770cdcb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-8f868116-5b0f-4c53-b4d3-8980770cdcb5" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-8f868116-5b0f-4c53-b4d3-8980770cdcb5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Deleting offline snapshot 8f868116-5b0f-4c53-b4d3-8980770cdcb5 of volume 0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] snapshot_file for this snap is: volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6aeca-56d8-4718-bba0-2584bea7bb38]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:56 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:56 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:56 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.712s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b67215b8-3a65-4663-8443-a3c83c7f3515 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-1014038678: creating Sep 23 00:18:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[38506e1e-8699-41a1-8785-09c54934c6a5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b67215b8-3a65-4663-8443-a3c83c7f3515 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-1014038678: created successfully Sep 23 00:18:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b67215b8-3a65-4663-8443-a3c83c7f3515 tempest-GroupSnapshotsTest-407265377 None] Create group completed successfully. Sep 23 00:18:57 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c Sep 23 00:18:57 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:57 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c" returned: 0 in 0.890s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:57 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:57 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:58 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 1.076s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:58 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5 Sep 23 00:18:58 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:59 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c.8f868116-5b0f-4c53-b4d3-8980770cdcb5" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-8f868116-5b0f-4c53-b4d3-8980770cdcb5" released by "_delete_snapshot" :: held 3.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" released by "delete_snapshot" :: held 3.597s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=60,cinder:UPDATE=66,cinder:INSERT=25,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=59,cinder:SELECT=61,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['f46436dd-9bbb-4c6f-88b6-3ce15a8432a2', '394575b1-3b9f-4a2b-b112-d43b550b5fa5', 'dd8742d9-4310-41bc-853f-de5ee2c7423b', 'db69a3de-e0fd-4e40-b674-66c747a7ce3d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (03204ab2-3437-478c-93a6-79a24616798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd34cb73-822a-490c-9c73-a5a513cf7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd34cb73-822a-490c-9c73-a5a513cf7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069060143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5adacc65-9cc4-46c2-8269-f79c886336ee,host='devstack@QuobyteHD#QuobyteHD',id=ac9a406a-7983-43ff-9bdf-605bf03ffc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:00Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb70397-e3b9-4e45-ad9f-9a5fee768d1f),volume_type_id=ddb70397-e3b9-4e45-ad9f-9a5fee768d1f)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244b3dc0-8734-4fad-ad04-a23246da8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244b3dc0-8734-4fad-ad04-a23246da8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f601ad-1590-44f4-a56e-a876f2594cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f601ad-1590-44f4-a56e-a876f2594cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9a406a-7983-43ff-9bdf-605bf03ffc33', 'volume_name': 'volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18690fa7-aeb6-4d25-b08a-ec8b5f2a452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18690fa7-aeb6-4d25-b08a-ec8b5f2a452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b289a-7e80-4e22-afc0-449762abaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Volume ac9a406a-7983-43ff-9bdf-605bf03ffc33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33', 'volume_size': 1} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5adacc65-9cc4-46c2-8269-f79c886336ee,created_at=2026-09-22T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069060143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5adacc65-9cc4-46c2-8269-f79c886336ee,host='devstack@QuobyteHD#QuobyteHD',id=ac9a406a-7983-43ff-9bdf-605bf03ffc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:00Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb70397-e3b9-4e45-ad9f-9a5fee768d1f),volume_type_id=ddb70397-e3b9-4e45-ad9f-9a5fee768d1f)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Creating volume ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:59 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 1073741824 Sep 23 00:18:59 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Delete snapshot completed successfully. Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-8f868116-5b0f-4c53-b4d3-8980770cdcb5-delete_snapshot" released by "delete_snapshot" :: held 4.214s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:18:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42f42b-c1fb-48f1-80d4-66c1862976de]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:00 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c Sep 23 00:19:00 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:00 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:00 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c Sep 23 00:19:00 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:01 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 1073741824" returned: 0 in 1.205s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:01 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:01 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:01 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0414b8db-a373-4416-ae9b-4212ed6ddb0c" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-0414b8db-a373-4416-ae9b-4212ed6ddb0c" released by "delete_volume" :: held 1.471s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['49722603-46e8-46ae-ac1a-f6e68bc7fbc3', '000df7f1-a93c-42fd-9560-59a495765522', 'd4c027e5-0d7a-43a4-91a0-5ccb25960026', '6835ee21-2244-46fa-984d-eec40b0ee20b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:01 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.573s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872b289a-7e80-4e22-afc0-449762abaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e16607-8082-46f1-b391-336241fe9ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Volume volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 (ac9a406a-7983-43ff-9bdf-605bf03ffc33): created successfully Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e16607-8082-46f1-b391-336241fe9ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (03204ab2-3437-478c-93a6-79a24616798b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4d635186-877c-4850-9552-1b89ef530382 tempest-GroupSnapshotsTest-407265377 None] Created volume successfully. Sep 23 00:19:01 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:01 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:02 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Deleted volume successfully. Sep 23 00:19:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-392f46ae-f556-4c6a-b773-e4301effbab9 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-0414b8db-a373-4416-ae9b-4212ed6ddb0c-delete_volume" released by "delete_volume" :: held 9.629s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] GroupSnapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: creating. Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Group snapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Creating offline snapshot 23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 of volume ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5eeb6-38b4-47df-a200-7b9a3d76f15e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:03 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.768s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:04 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 1G Sep 23 00:19:04 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (c7623fe3-042d-4e60-a0e7-5ca4d3ef632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e804f2-1fb2-48e6-aaac-e5d3aa3fdea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e804f2-1fb2-48e6-aaac-e5d3aa3fdea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-985964655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e7597-4257-43d9-a9d9-a3509a2b2a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e360a546fb4f4801b5717390d1355334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:04Z,use_quota=True,user_id='4d1c7d03faa64a59bcc2711cd879a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905edd7-37e9-48e0-9f64-6d76b78968de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905edd7-37e9-48e0-9f64-6d76b78968de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6934aad0-4caa-4a53-baf9-5ea07cd52558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6934aad0-4caa-4a53-baf9-5ea07cd52558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2e7597-4257-43d9-a9d9-a3509a2b2a29', 'volume_name': 'volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad5dbca-c253-45da-9b13-34c69c508851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad5dbca-c253-45da-9b13-34c69c508851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23ecf35-df7c-40cc-82cf-b46fc3d470a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Volume be2e7597-4257-43d9-a9d9-a3509a2b2a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29', 'volume_size': 1} Sep 23 00:19:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:05 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 1G" returned: 0 in 0.816s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:05 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:05 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:05 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:05 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info Sep 23 00:19:05 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info Sep 23 00:19:06 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.info" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.250s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-985964655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e7597-4257-43d9-a9d9-a3509a2b2a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e360a546fb4f4801b5717390d1355334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:04Z,use_quota=True,user_id='4d1c7d03faa64a59bcc2711cd879a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Creating volume be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 1073741824 Sep 23 00:19:06 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2cfaf6c3-68d8-403a-a0e7-d091027d6998 tempest-GroupSnapshotsTest-407265377 None] group_snapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: created successfully Sep 23 00:19:07 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 1073741824" returned: 0 in 0.647s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:07 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:07 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 0.592s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23ecf35-df7c-40cc-82cf-b46fc3d470a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b89e2c-ba22-4c5c-9506-3a09008e898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Volume volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 (be2e7597-4257-43d9-a9d9-a3509a2b2a29): created successfully Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b89e2c-ba22-4c5c-9506-3a09008e898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (c7623fe3-042d-4e60-a0e7-5ca4d3ef632a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e6e57091-1e89-4740-a803-e626a14e21c4 tempest-VolumesDeleteCascade-1913570724 None] Created volume successfully. Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Creating volume 8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 from snapshot 23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] snapshot: 23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3, volume: 8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb3aa5c-255c-4229-ac2f-69a8c5f2d0b1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:09 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:09 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:09 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.595s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda88c52-382a-415d-9395-6683dc6e80ed]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:09 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:09 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:10 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:19:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:19:10 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:19:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:10 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 Sep 23 00:19:10 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" returned: 0 in 8.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:18 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Converted 1024.00 MB image at 122.57 MB/s Sep 23 00:19:18 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 Sep 23 00:19:18 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" released by "_copy_volume_from_snapshot" :: held 9.823s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" released by "_create_volume_from_snapshot" :: held 9.966s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.528s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Creating offline snapshot 4ef53669-55ab-48b8-b910-d5cc7ab9f32e of volume be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4906ec93-ccec-4874-b967-8b00b7974f68]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c5488434-7d80-4d82-bc65-83e9933c6089 tempest-GroupSnapshotsTest-407265377 None] Create group from source-snapshot-9d6e43c1-5c69-43fe-9b97-e68f428ef206 completed successfully. Sep 23 00:19:19 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:19 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e 1G Sep 23 00:19:19 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e 1G" returned: 0 in 0.681s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:20 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e is being set with open permissions: ugo+rw Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:20 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[58385cc4-2c8d-43b9-a749-503ce0677763]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 Sep 23 00:19:21 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info Sep 23 00:19:21 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" returned: 0 in 0.594s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3 Sep 23 00:19:21 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info is being set with open permissions: ugo+rw Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info Sep 23 00:19:21 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-8d6ede79-878c-47e7-bdc8-e9cbcf5e52d3" released by "delete_volume" :: held 1.010s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['d9e29120-a8b6-4287-a408-267a4b62c804'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:21 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2123774477 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2123774477, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:21 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2123774477 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2123774477, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:21 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.info" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['d0396ffc-f8be-46a8-9a5d-c05a716a07f3', 'df6cecd0-b11d-45b5-94e2-e0a69d4baafd', '06c6499a-440a-4eeb-b8c2-c6230b9b1431', 'a1c82303-2ef8-4f81-94a0-8ccc0d81361b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-269b28f0-76b5-4414-87f6-6571d3b32aef tempest-VolumesDeleteCascade-1913570724 None] Create snapshot completed successfully Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:22 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d459ba4f-0099-45ed-a71b-70e117f52ba3 tempest-GroupSnapshotsTest-407265377 None] Delete group completed successfully. Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (14b59d70-9037-4e79-b5dc-486119c9e7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feae288b-03cb-4302-8d9d-e41114cab465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feae288b-03cb-4302-8d9d-e41114cab465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-627690443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e8501d-c01b-4ae0-aaed-9721c1653f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e360a546fb4f4801b5717390d1355334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ef53669-55ab-48b8-b910-d5cc7ab9f32e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:23Z,use_quota=True,user_id='4d1c7d03faa64a59bcc2711cd879a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3e561f-1972-48b5-b044-222d6e06add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3e561f-1972-48b5-b044-222d6e06add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864e93c8-b2ee-42d5-8399-5c5ccfe4d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864e93c8-b2ee-42d5-8399-5c5ccfe4d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84e8501d-c01b-4ae0-aaed-9721c1653f49', 'volume_name': 'volume-84e8501d-c01b-4ae0-aaed-9721c1653f49', 'volume_size': 1, 'snapshot_id': '4ef53669-55ab-48b8-b910-d5cc7ab9f32e'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a90b1-7691-4841-abf5-f7300d30ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a90b1-7691-4841-abf5-f7300d30ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86265f31-1272-435d-8596-0e8dfb80b5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Volume 84e8501d-c01b-4ae0-aaed-9721c1653f49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84e8501d-c01b-4ae0-aaed-9721c1653f49', 'volume_size': 1, 'snapshot_id': '4ef53669-55ab-48b8-b910-d5cc7ab9f32e'} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-84e8501d-c01b-4ae0-aaed-9721c1653f49" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-84e8501d-c01b-4ae0-aaed-9721c1653f49" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Creating volume 84e8501d-c01b-4ae0-aaed-9721c1653f49 from snapshot 4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] snapshot: 4ef53669-55ab-48b8-b910-d5cc7ab9f32e, volume: 84e8501d-c01b-4ae0-aaed-9721c1653f49, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] group_snapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: deleting Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be759f-37e8-409c-9e6f-0eee03360f7c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] group_snapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Deleting offline snapshot 23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 of volume ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] snapshot_file for this snap is: volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[398dac39-e359-4a51-b75f-46da9adcc364]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:23 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:23 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:23 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (e7e79a35-0f63-4bec-9db3-2043b2a8997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e347b1b3-b531-4af1-a056-f91592996c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e347b1b3-b531-4af1-a056-f91592996c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1864853950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ea248-7ee2-47e4-a62d-bb70f26032b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ea248-7ee2-47e4-a62d-bb70f26032b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a3c67-a771-4374-b11b-f83aa0f4c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a3c67-a771-4374-b11b-f83aa0f4c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3', 'volume_name': 'volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f042ef-e3ba-41d6-a516-69b80fcbfcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f042ef-e3ba-41d6-a516-69b80fcbfcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02425c8-f3d0-45d2-9d0f-664db201381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Volume 2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3', 'volume_size': 1} Sep 23 00:19:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.643s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d57d4-d575-494c-9dbc-df1807cca725]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[671dca71-0dd6-46a8-9848-fc68974461e3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:24 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:24 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:24 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:19:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 Sep 23 00:19:24 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:25 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.712s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3 Sep 23 00:19:25 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:26 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33.23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" returned: 0 in 0.842s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-23c7e358-dfc1-4e60-9ef9-d84f7ee8adc3" released by "_delete_snapshot" :: held 3.091s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" released by "delete_snapshot" :: held 3.121s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:26 devstack cinder-volume[87132]: WARNING cinder.quota [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2123774477 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2123774477, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] Created reservations ['a9fb735f-d50b-40de-97eb-05e164619f89', '101d9a27-834e-41cf-80cd-e93a588f08fa', '6a53f9e0-e6db-470e-9921-6aa58581d0e9', 'aed2f5da-ad5d-4f83-94d1-f2142c9882e9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fea0d889-40ef-4201-bac9-3043d735761e tempest-GroupSnapshotsTest-407265377 None] group_snapshot 9d6e43c1-5c69-43fe-9b97-e68f428ef206: deleted successfully Sep 23 00:19:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" acquired by "delete_volume" :: waited 0.075s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed64228-bbdf-4e67-80b4-5ffa4f64adaa]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:28 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.746s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33 Sep 23 00:19:29 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ac9a406a-7983-43ff-9bdf-605bf03ffc33" returned: 0 in 0.876s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-ac9a406a-7983-43ff-9bdf-605bf03ffc33" released by "delete_volume" :: held 1.879s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Created reservations ['98bdbe63-1227-49c6-b295-dc42b1d04b67'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:30 devstack cinder-volume[87132]: WARNING cinder.db.api [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2123774477'] Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Created reservations ['638de24a-744c-4a8a-86e3-018ccc78d9b4', 'a3c961b3-a937-45cc-9df7-417eeb67fa4c', '587ab401-aab3-4001-b8f4-63195042df7c', '1f251d1f-eda7-4434-9183-caae4626d872'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:30 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:30 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-effd023a-a718-4574-8ce7-69296c9d9deb tempest-GroupSnapshotsTest-407265377 None] Delete group completed successfully. Sep 23 00:19:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3baca715-2b9f-42e0-a09c-3e2f2871df37 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-482879471: creating Sep 23 00:19:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3baca715-2b9f-42e0-a09c-3e2f2871df37 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-482879471: created successfully Sep 23 00:19:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3baca715-2b9f-42e0-a09c-3e2f2871df37 tempest-GroupSnapshotsTest-407265377 None] Create group completed successfully. Sep 23 00:19:34 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49" returned: 0 in 10.144s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29, size 1024.00 MB, duration 10.15 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:34 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Converted 1024.00 MB image at 100.92 MB/s Sep 23 00:19:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 is being set with open permissions: ugo+rw Sep 23 00:19:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 Sep 23 00:19:34 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (154514f3-ba28-460b-83a3-3f428e88e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ae6f3b-aa44-4d40-8441-52149e0a9635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ae6f3b-aa44-4d40-8441-52149e0a9635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478465371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,host='devstack@QuobyteHD#QuobyteHD',id=dc89617d-7c90-468a-893d-5ba12f32b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c299e43-5745-40ac-8920-ed2e07a81b65),volume_type_id=4c299e43-5745-40ac-8920-ed2e07a81b65)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9fbb17-6ff7-4cd1-940d-6a7a2bde87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9fbb17-6ff7-4cd1-940d-6a7a2bde87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48156852-1c53-4477-8ad0-394571f01c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48156852-1c53-4477-8ad0-394571f01c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc89617d-7c90-468a-893d-5ba12f32b266', 'volume_name': 'volume-dc89617d-7c90-468a-893d-5ba12f32b266', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a318bcaf-09ce-4c0b-a8f8-4885a8cdf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a318bcaf-09ce-4c0b-a8f8-4885a8cdf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3bb3b7-d502-453c-aa34-b563a7f04854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Volume dc89617d-7c90-468a-893d-5ba12f32b266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc89617d-7c90-468a-893d-5ba12f32b266', 'volume_size': 1} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:35 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49" returned: 0 in 0.567s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" released by "_copy_volume_from_snapshot" :: held 12.037s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-84e8501d-c01b-4ae0-aaed-9721c1653f49" released by "_create_volume_from_snapshot" :: held 12.162s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.202s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.509s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1864853950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Creating volume 2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:35 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 1073741824 Sep 23 00:19:35 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86265f31-1272-435d-8596-0e8dfb80b5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e8501d-c01b-4ae0-aaed-9721c1653f49', 'volume_size': 1, 'snapshot_id': '4ef53669-55ab-48b8-b910-d5cc7ab9f32e'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6cee9-b432-472f-a6dc-eb1b57539921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Volume volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 (84e8501d-c01b-4ae0-aaed-9721c1653f49): created successfully Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6cee9-b432-472f-a6dc-eb1b57539921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Flow 'volume_create_manager' (14b59d70-9037-4e79-b5dc-486119c9e7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b832d42-f3b7-4414-82e1-65076ca8e5f6 tempest-VolumesDeleteCascade-1913570724 None] Created volume successfully. Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-be2e7597-4257-43d9-a9d9-a3509a2b2a29-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-be2e7597-4257-43d9-a9d9-a3509a2b2a29-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Performing cascade delete. {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Deleting offline snapshot 4ef53669-55ab-48b8-b910-d5cc7ab9f32e of volume be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] snapshot_file for this snap is: volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 1073741824" returned: 0 in 0.950s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824e609-1460-4366-b393-e3cfbec43335]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 Sep 23 00:19:36 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:36 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,created_at=2026-09-22T22:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478465371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,host='devstack@QuobyteHD#QuobyteHD',id=dc89617d-7c90-468a-893d-5ba12f32b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c299e43-5745-40ac-8920-ed2e07a81b65),volume_type_id=4c299e43-5745-40ac-8920-ed2e07a81b65)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Creating volume dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02425c8-f3d0-45d2-9d0f-664db201381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965f48c7-3535-4561-b136-a6f152796831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Volume volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 (2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3): created successfully Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965f48c7-3535-4561-b136-a6f152796831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:37 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 1073741824 Sep 23 00:19:37 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (e7e79a35-0f63-4bec-9db3-2043b2a8997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.698s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7e0181b8-d468-4f62-8b52-6f7727d967d8 tempest-AttachVolumeTestJSON-1274710783 None] Created volume successfully. Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c518e96-33d2-4fbf-b1f2-a6bb3f0714c9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:37 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:38 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 1073741824" returned: 0 in 1.136s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:38 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 1.124s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 Sep 23 00:19:38 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:38 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:38 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266" returned: 0 in 0.867s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3bb3b7-d502-453c-aa34-b563a7f04854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc89617d-7c90-468a-893d-5ba12f32b266', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a74fcf-621a-4448-b6c7-073b392c3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.966s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Volume volume-dc89617d-7c90-468a-893d-5ba12f32b266 (dc89617d-7c90-468a-893d-5ba12f32b266): created successfully Sep 23 00:19:39 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a74fcf-621a-4448-b6c7-073b392c3295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (154514f3-ba28-460b-83a3-3f428e88e115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7aeaec7c-1539-4722-8fe9-e5644a2d2bdd tempest-GroupSnapshotsTest-407265377 None] Created volume successfully. Sep 23 00:19:39 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29.4ef53669-55ab-48b8-b910-d5cc7ab9f32e" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-4ef53669-55ab-48b8-b910-d5cc7ab9f32e" released by "_delete_snapshot" :: held 3.606s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" released by "delete_snapshot" :: held 3.640s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['57471697-0396-4745-b9f1-e617aa16c90f', 'ceda6a81-3d1a-4010-b53e-5520dd62bd51', '24cb9632-0256-49c3-9576-d597379002de', '9e655875-9e41-4ab9-9de1-32db529792bb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Delete snapshot completed successfully. Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-4ef53669-55ab-48b8-b910-d5cc7ab9f32e-delete_snapshot" released by "delete_snapshot" :: held 3.935s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Snapshots deleted, issuing volume delete {{(pid=87132) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0cb741-d436-480f-bfed-37fada05ad3a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-bff7c8f6-9609-4122-a59b-bd6c9dc5ea30 req-7cfd6196-3e22-42e9-adcb-58a2cbbac85f tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-bff7c8f6-9609-4122-a59b-bd6c9dc5ea30 req-7cfd6196-3e22-42e9-adcb-58a2cbbac85f tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-bff7c8f6-9609-4122-a59b-bd6c9dc5ea30 req-7cfd6196-3e22-42e9-adcb-58a2cbbac85f tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-bff7c8f6-9609-4122-a59b-bd6c9dc5ea30 req-7cfd6196-3e22-42e9-adcb-58a2cbbac85f tempest-AttachVolumeTestJSON-1274710783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53dd6b99-796b-4594-930c-db13312fb281', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:19:40 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:40 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-bff7c8f6-9609-4122-a59b-bd6c9dc5ea30 req-7cfd6196-3e22-42e9-adcb-58a2cbbac85f tempest-AttachVolumeTestJSON-1274710783 None] attachment_update completed successfully. Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Flow 'volume_create_manager' (83b98cab-c8af-40c5-bdf1-688fbcaab81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b0fea-891b-45f5-b5a3-de21622ac405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b0fea-891b-45f5-b5a3-de21622ac405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1704556861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbc2ffa-5918-474d-955d-82f927125975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294d018f9e8c4aa4ad855fcbb9f39c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:41Z,use_quota=True,user_id='cefb8032567d4f59931d042cf0c99082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd7fbe2-3a95-41cc-8521-20593a32e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd7fbe2-3a95-41cc-8521-20593a32e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8b278-343a-4fcb-be11-e51a41831a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a8b278-343a-4fcb-be11-e51a41831a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbc2ffa-5918-474d-955d-82f927125975', 'volume_name': 'volume-fcbc2ffa-5918-474d-955d-82f927125975', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294e5931-05bd-41ba-875a-d1878816f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294e5931-05bd-41ba-875a-d1878816f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2214dd-12e1-41d6-8247-d21b5ce10366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume fcbc2ffa-5918-474d-955d-82f927125975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbc2ffa-5918-474d-955d-82f927125975', 'volume_size': 1} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1704556861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbc2ffa-5918-474d-955d-82f927125975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294d018f9e8c4aa4ad855fcbb9f39c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:41Z,use_quota=True,user_id='cefb8032567d4f59931d042cf0c99082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Creating volume fcbc2ffa-5918-474d-955d-82f927125975 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:41 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 0.864s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 1073741824 Sep 23 00:19:41 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29 Sep 23 00:19:41 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-be2e7597-4257-43d9-a9d9-a3509a2b2a29" returned: 0 in 0.677s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-be2e7597-4257-43d9-a9d9-a3509a2b2a29" released by "delete_volume" :: held 1.678s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['42b666cf-919e-4749-8ee8-98a29737fca1', '9913ac13-4e73-41ca-9f63-bec78a9366d5', 'ff48b965-b82c-4b9f-8064-f93a8066dad5', '1b068fb0-56a3-4976-9b88-ee7ec44a3563'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:42 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:42 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:42 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 1073741824" returned: 0 in 1.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (f66dfd46-533a-434a-9a8e-646f39b4d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e114c5-b7b9-427b-8643-f047103ab62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Flow 'volume_create_manager' (b04347bc-5e75-4646-b049-c51412b09334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb4e053-0d30-4460-9fab-68f4c76cea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e114c5-b7b9-427b-8643-f047103ab62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931077767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,host='devstack@QuobyteHD#QuobyteHD',id=279f2edb-edc8-4011-b5c7-ebf4b797d1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:42Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c299e43-5745-40ac-8920-ed2e07a81b65),volume_type_id=4c299e43-5745-40ac-8920-ed2e07a81b65)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763bf5fa-766b-4d28-a932-2f21ab08a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763bf5fa-766b-4d28-a932-2f21ab08a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870814f3-ce89-4648-a00e-683428ff40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870814f3-ce89-4648-a00e-683428ff40ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279f2edb-edc8-4011-b5c7-ebf4b797d1df', 'volume_name': 'volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc55478-4532-44e8-a67c-50ab770f9ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc55478-4532-44e8-a67c-50ab770f9ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f61c5a-a6d7-4e93-a54e-f1f2a7d2f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Volume 279f2edb-edc8-4011-b5c7-ebf4b797d1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df', 'volume_size': 1} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb4e053-0d30-4460-9fab-68f4c76cea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2060889720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5f950a-7619-4542-a495-4753158f37be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294d018f9e8c4aa4ad855fcbb9f39c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:42Z,use_quota=True,user_id='cefb8032567d4f59931d042cf0c99082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c223b553-1f57-4158-a5ce-33cb401fdc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c223b553-1f57-4158-a5ce-33cb401fdc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75223387-a229-4423-b188-e0fe68908f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75223387-a229-4423-b188-e0fe68908f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5f950a-7619-4542-a495-4753158f37be', 'volume_name': 'volume-1c5f950a-7619-4542-a495-4753158f37be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c9470c-58ad-49fa-9a1b-e49b2103b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c9470c-58ad-49fa-9a1b-e49b2103b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125db89c-9b37-4228-aabb-1279178696f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume 1c5f950a-7619-4542-a495-4753158f37be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5f950a-7619-4542-a495-4753158f37be', 'volume_size': 1} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:42 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 Sep 23 00:19:43 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Deleted volume successfully. Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-da9b3792-fb45-401d-bcc4-151df7007cb6 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-be2e7597-4257-43d9-a9d9-a3509a2b2a29-delete_volume" released by "delete_volume" :: held 6.879s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:43 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1931077767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5f23b7e-507c-49e8-a5ad-e7872c0a70cb,host='devstack@QuobyteHD#QuobyteHD',id=279f2edb-edc8-4011-b5c7-ebf4b797d1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:42Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c299e43-5745-40ac-8920-ed2e07a81b65),volume_type_id=4c299e43-5745-40ac-8920-ed2e07a81b65)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Creating volume 279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df 1073741824 Sep 23 00:19:43 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2214dd-12e1-41d6-8247-d21b5ce10366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbc2ffa-5918-474d-955d-82f927125975', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be8898e-d0cb-4e19-a9eb-eedaeafe9393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume volume-fcbc2ffa-5918-474d-955d-82f927125975 (fcbc2ffa-5918-474d-955d-82f927125975): created successfully Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be8898e-d0cb-4e19-a9eb-eedaeafe9393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Flow 'volume_create_manager' (83b98cab-c8af-40c5-bdf1-688fbcaab81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4f5a355f-ce8e-4fac-b0bd-d1c478b45a88 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Created volume successfully. Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-84e8501d-c01b-4ae0-aaed-9721c1653f49-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-84e8501d-c01b-4ae0-aaed-9721c1653f49-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4cb3ee-1c0d-4e99-95e5-079b139f6ad4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (4b625a7b-ed77-4b57-b13d-6335c439f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:44 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 Sep 23 00:19:44 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645ab6a9-dcf6-4319-a11d-81654a7318ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645ab6a9-dcf6-4319-a11d-81654a7318ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1145102496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e09ee52-8a02-40e1-8549-c9e00f387ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:44Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c44267-a55b-42d6-a273-331d0f3f4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c44267-a55b-42d6-a273-331d0f3f4321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f237bb-2fe8-4954-bf62-70578855b4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f237bb-2fe8-4954-bf62-70578855b4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e09ee52-8a02-40e1-8549-c9e00f387ca1', 'volume_name': 'volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1179ca-98f6-4056-9828-dea9c0a76537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1179ca-98f6-4056-9828-dea9c0a76537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea46221-0b48-482a-8c75-68eabaa34771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Volume 8e09ee52-8a02-40e1-8549-c9e00f387ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1', 'volume_size': 1} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:44 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df 1073741824" returned: 0 in 1.025s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df Sep 23 00:19:44 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49 Sep 23 00:19:44 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2060889720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5f950a-7619-4542-a495-4753158f37be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294d018f9e8c4aa4ad855fcbb9f39c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:42Z,use_quota=True,user_id='cefb8032567d4f59931d042cf0c99082',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Creating volume 1c5f950a-7619-4542-a495-4753158f37be {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f61c5a-a6d7-4e93-a54e-f1f2a7d2f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be 1073741824 Sep 23 00:19:45 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb696ee-3c7f-42e5-8ecc-b36101d9bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Volume volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df (279f2edb-edc8-4011-b5c7-ebf4b797d1df): created successfully Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb696ee-3c7f-42e5-8ecc-b36101d9bf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (f66dfd46-533a-434a-9a8e-646f39b4d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9006bf42-53f3-4ccb-9861-eaf551bdb749 tempest-GroupSnapshotsTest-407265377 None] Created volume successfully. Sep 23 00:19:45 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-84e8501d-c01b-4ae0-aaed-9721c1653f49" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-quobyte-84e8501d-c01b-4ae0-aaed-9721c1653f49" released by "delete_volume" :: held 1.242s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Created reservations ['c8318258-d1a0-44be-8429-3748ae7a57c5', '2cd31061-3155-4451-b261-1827b953ab6a', '7d418642-e1ff-4c1c-857f-594cfbe07498', '4208830a-4e62-4ad2-ae99-d9cf51b211c3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-48868f68-503a-421c-a40f-87283c0d15a3 tempest-GroupSnapshotsTest-407265377 None] Update group completed successfully. Sep 23 00:19:45 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:45 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be 1073741824" returned: 0 in 0.783s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be Sep 23 00:19:45 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Deleted volume successfully. Sep 23 00:19:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69f67f5f-cbc2-4e8d-9007-85b5d6589313 tempest-VolumesDeleteCascade-1913570724 None] Lock "cinder-84e8501d-c01b-4ae0-aaed-9721c1653f49-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:46 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1145102496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e09ee52-8a02-40e1-8549-c9e00f387ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aae86867cf942298ca1a74064613f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:44Z,use_quota=True,user_id='11dfb86ab66945a08f017ea774af13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Creating volume 8e09ee52-8a02-40e1-8549-c9e00f387ca1 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125db89c-9b37-4228-aabb-1279178696f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5f950a-7619-4542-a495-4753158f37be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:46 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 1073741824 Sep 23 00:19:46 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aa652c-f009-404f-9566-afba20973cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Volume volume-1c5f950a-7619-4542-a495-4753158f37be (1c5f950a-7619-4542-a495-4753158f37be): created successfully Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aa652c-f009-404f-9566-afba20973cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Flow 'volume_create_manager' (b04347bc-5e75-4646-b049-c51412b09334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-57e9123f-56eb-465d-99d7-64d37553c36a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Created volume successfully. Sep 23 00:19:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d457561-0b91-41d2-a789-7ba2941c1e56 tempest-GroupSnapshotsTest-407265377 None] Update group completed successfully. Sep 23 00:19:46 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 1073741824" returned: 0 in 0.754s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:47 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 Sep 23 00:19:47 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:47 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea46221-0b48-482a-8c75-68eabaa34771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe30489-05be-4117-8389-30ff175a60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Volume volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 (8e09ee52-8a02-40e1-8549-c9e00f387ca1): created successfully Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe30489-05be-4117-8389-30ff175a60e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Flow 'volume_create_manager' (4b625a7b-ed77-4b57-b13d-6335c439f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-203442b1-bda4-4da8-8dae-54404b1f4ebf tempest-AttachVolumeTestJSON-1274710783 None] Created volume successfully. Sep 23 00:19:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4dcfca73-60d0-4756-8d39-015267349f94 tempest-GroupSnapshotsTest-407265377 None] Update group completed successfully. Sep 23 00:19:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-384ffe67-7343-48a0-a721-097b4ed08454 tempest-GroupSnapshotsTest-407265377 None] Update group completed successfully. Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:19:49 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:50 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a105b0f0-3491-4e77-89fb-235f74a68563 req-9b479887-8e46-4633-8571-d7ec7a75fbea tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a105b0f0-3491-4e77-89fb-235f74a68563 req-9b479887-8e46-4633-8571-d7ec7a75fbea tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-a105b0f0-3491-4e77-89fb-235f74a68563 req-9b479887-8e46-4633-8571-d7ec7a75fbea tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-a105b0f0-3491-4e77-89fb-235f74a68563 req-9b479887-8e46-4633-8571-d7ec7a75fbea tempest-AttachVolumeTestJSON-1274710783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7423d2bb-4fe3-4fde-9416-fefd72173613', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:19:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-a105b0f0-3491-4e77-89fb-235f74a68563 req-9b479887-8e46-4633-8571-d7ec7a75fbea tempest-AttachVolumeTestJSON-1274710783 None] attachment_update completed successfully. Sep 23 00:19:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] GroupSnapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: creating. Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Group snapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Creating offline snapshot 81ff6661-7e1c-4587-82f6-3d814105bacc of volume dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d980f9-f7c1-4dce-ae36-300400abffc1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:52 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 Sep 23 00:19:52 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:52 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266" returned: 0 in 0.757s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:53 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc 1G Sep 23 00:19:53 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0a9f1e29-feb8-428e-be99-d22044d3c861 req-dbfcd08e-8ff4-426c-9109-b5fa94e41789 tempest-AttachVolumeTestJSON-1274710783 None] Terminate volume connection completed successfully. Sep 23 00:19:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0a9f1e29-feb8-428e-be99-d22044d3c861 req-dbfcd08e-8ff4-426c-9109-b5fa94e41789 tempest-AttachVolumeTestJSON-1274710783 None] Deleting attachment 53dd6b99-796b-4594-930c-db13312fb281. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:53 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc 1G" returned: 0 in 0.808s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc89617d-7c90-468a-893d-5ba12f32b266 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:53 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc89617d-7c90-468a-893d-5ba12f32b266 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc Sep 23 00:19:53 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Flow 'volume_create_manager' (67ead449-1100-452f-a7d0-3cd39a2d1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e28f3b-a68d-4894-8858-6d77594a2c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e28f3b-a68d-4894-8858-6d77594a2c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-160810369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07812bf-c852-4c8d-acbe-6cb442055f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13c7bc192874d51bb7bc17ee677b359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:54Z,use_quota=True,user_id='6e0e3682830941e3a8be83be6a4ce844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d5979-11dc-415c-b8c3-a91079531ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d5979-11dc-415c-b8c3-a91079531ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22405c-64cb-4a89-887c-4c14b131a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b22405c-64cb-4a89-887c-4c14b131a779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07812bf-c852-4c8d-acbe-6cb442055f32', 'volume_name': 'volume-b07812bf-c852-4c8d-acbe-6cb442055f32', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a93ee69-2512-4385-82a5-72289f6c34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a93ee69-2512-4385-82a5-72289f6c34e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e54c5a8-8612-4e6f-b122-9b9f8ed0267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Volume b07812bf-c852-4c8d-acbe-6cb442055f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07812bf-c852-4c8d-acbe-6cb442055f32', 'volume_size': 1} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:54 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc89617d-7c90-468a-893d-5ba12f32b266 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:54 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:54 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc Sep 23 00:19:54 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:54 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:54 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info Sep 23 00:19:54 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:55 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info" returned: 0 in 0.741s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:55 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:55 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info Sep 23 00:19:55 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2f0f356f-b341-4e4b-aa43-4e7752017033 req-71b33f99-91bd-4cf2-b062-d386e92e3a1b tempest-AttachVolumeTestJSON-1274710783 None] Terminate volume connection completed successfully. Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2f0f356f-b341-4e4b-aa43-4e7752017033 req-71b33f99-91bd-4cf2-b062-d386e92e3a1b tempest-AttachVolumeTestJSON-1274710783 None] Deleting attachment 7423d2bb-4fe3-4fde-9416-fefd72173613. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:56 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.info" returned: 0 in 0.810s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.304s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Creating offline snapshot 82843ad4-00d2-44ee-a050-9ce394e43d2c of volume 279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ddb33-8afc-4b6c-ad9e-2114b2057db9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:56 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df Sep 23 00:19:56 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:57 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:57 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c 1G Sep 23 00:19:57 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:57 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c 1G" returned: 0 in 0.769s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:57 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c Sep 23 00:19:57 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:58 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:58 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:58 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c Sep 23 00:19:58 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:58 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info Sep 23 00:19:59 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:59 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info" returned: 0 in 0.818s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info Sep 23 00:19:59 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.info" returned: 0 in 0.453s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.934s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.145s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-160810369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07812bf-c852-4c8d-acbe-6cb442055f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13c7bc192874d51bb7bc17ee677b359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:54Z,use_quota=True,user_id='6e0e3682830941e3a8be83be6a4ce844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Creating volume b07812bf-c852-4c8d-acbe-6cb442055f32 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=106,cinder:INSERT=24,cinder:UPDATE=108,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:00 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 1073741824 Sep 23 00:20:00 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=117,cinder:INSERT=24,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b3f1509-725e-4758-9787-66eff137b05a tempest-GroupSnapshotsTest-407265377 None] group_snapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: created successfully Sep 23 00:20:01 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 1073741824" returned: 0 in 0.925s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] group_snapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: deleting Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] group_snapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-81ff6661-7e1c-4587-82f6-3d814105bacc" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:01 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 Sep 23 00:20:01 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-81ff6661-7e1c-4587-82f6-3d814105bacc" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Deleting offline snapshot 81ff6661-7e1c-4587-82f6-3d814105bacc of volume dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] snapshot_file for this snap is: volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce73b95e-26cb-4c44-b494-5c716f74809f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:01 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc Sep 23 00:20:01 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e54c5a8-8612-4e6f-b122-9b9f8ed0267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07812bf-c852-4c8d-acbe-6cb442055f32', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a11e5-8691-45e8-a223-c5ff213bcd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Volume volume-b07812bf-c852-4c8d-acbe-6cb442055f32 (b07812bf-c852-4c8d-acbe-6cb442055f32): created successfully Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686a11e5-8691-45e8-a223-c5ff213bcd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Flow 'volume_create_manager' (67ead449-1100-452f-a7d0-3cd39a2d1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b16189c5-2aad-45ed-87c1-1dc5dfc0c867 tempest-VolumesMetadataTest-7854060 None] Created volume successfully. Sep 23 00:20:02 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc" returned: 0 in 0.708s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc89617d-7c90-468a-893d-5ba12f32b266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa221db9-bd62-4bd2-a848-a47756a942d3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 Sep 23 00:20:02 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266" returned: 0 in 0.566s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc Sep 23 00:20:02 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:03 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc" returned: 0 in 0.709s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:03 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc Sep 23 00:20:03 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266.81ff6661-7e1c-4587-82f6-3d814105bacc" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-81ff6661-7e1c-4587-82f6-3d814105bacc" released by "_delete_snapshot" :: held 2.557s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" released by "delete_snapshot" :: held 2.604s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-82843ad4-00d2-44ee-a050-9ce394e43d2c" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-82843ad4-00d2-44ee-a050-9ce394e43d2c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Deleting offline snapshot 82843ad4-00d2-44ee-a050-9ce394e43d2c of volume 279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] snapshot_file for this snap is: volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928bc0c-cdff-4980-9181-371c672f396c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c Sep 23 00:20:04 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Acquiring lock "cinder-b07812bf-c852-4c8d-acbe-6cb442055f32-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "cinder-b07812bf-c852-4c8d-acbe-6cb442055f32-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c" returned: 0 in 0.755s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483a0d6-5d4f-45a8-8bc9-3eb1414b34ef]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Acquiring lock "cinder-quobyte-b07812bf-c852-4c8d-acbe-6cb442055f32" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "cinder-quobyte-b07812bf-c852-4c8d-acbe-6cb442055f32" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7844a7-f763-424f-91d7-58962aebcbd9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df Sep 23 00:20:05 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 Sep 23 00:20:05 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df" returned: 0 in 0.776s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c Sep 23 00:20:05 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32" returned: 0 in 0.709s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32 Sep 23 00:20:05 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-8e09ee52-8a02-40e1-8549-c9e00f387ca1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b07812bf-c852-4c8d-acbe-6cb442055f32" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-8e09ee52-8a02-40e1-8549-c9e00f387ca1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "cinder-quobyte-b07812bf-c852-4c8d-acbe-6cb442055f32" released by "delete_volume" :: held 1.311s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-quobyte-8e09ee52-8a02-40e1-8549-c9e00f387ca1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-8e09ee52-8a02-40e1-8549-c9e00f387ca1" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:06 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c" returned: 0 in 0.719s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc7342c-e864-4292-aea7-7836676e3c6a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c Sep 23 00:20:06 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Created reservations ['a3194916-8f9e-4067-b765-1a5d1ece967f', '73a48282-2e20-4397-b9ae-eda601e9c429', 'e3efe07c-980e-41f8-b971-1d03ede2ecb8', '865bbc2a-9948-46b4-9a78-a066039edbb7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:06 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 Sep 23 00:20:06 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df.82843ad4-00d2-44ee-a050-9ce394e43d2c" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-82843ad4-00d2-44ee-a050-9ce394e43d2c" released by "_delete_snapshot" :: held 2.826s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" released by "delete_snapshot" :: held 2.871s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:07 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Deleted volume successfully. Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09cd024a-0024-4999-9c1d-f06f813d4f60 tempest-VolumesMetadataTest-7854060 None] Lock "cinder-b07812bf-c852-4c8d-acbe-6cb442055f32-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1322510186 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1322510186, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:07 devstack cinder-volume[87132]: WARNING cinder.quota [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1322510186 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1322510186, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['54d86912-6120-4ad3-9212-c54d7291f295', '24c0c911-f3a6-48a1-9ecb-3e3a1593236e', '93280c49-7fec-4ec9-aa4c-97f9a769654c', 'e46cf949-3dbc-45a8-8c93-6247e02633e2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:07 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1" returned: 0 in 0.827s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:07 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1 Sep 23 00:20:07 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['39f555ca-c80e-4b91-83a5-6ea21611dcfc', '6748a25f-602b-4e1f-98ce-b42ce66d8eae', '6c65a3f1-7cd1-46ea-898a-1652917c016e', '7885d573-bf58-469c-8977-ecdb4e8237d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-402554bc-3e51-4874-b96c-ded6c8b99b80 tempest-GroupSnapshotsTest-407265377 None] group_snapshot c8a911d0-7132-4f3c-9b3c-863654d3e5c2: deleted successfully Sep 23 00:20:07 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8e09ee52-8a02-40e1-8549-c9e00f387ca1" returned: 0 in 0.554s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-8e09ee52-8a02-40e1-8549-c9e00f387ca1" released by "delete_volume" :: held 1.452s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Created reservations ['40cd97a0-d804-4ba0-9d7c-50331a48991d', '9a5bf337-2da6-47f4-912b-23afadd4ada4', '395ace91-fd27-4f0f-adb3-d02b57ec77d8', 'a0e22f14-0ce1-4cc5-93a7-64800657b1e0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:08 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:08 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Deleted volume successfully. Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-11ad3cf5-332d-4717-8f8a-07c1439682b4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-8e09ee52-8a02-40e1-8549-c9e00f387ca1-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-quobyte-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b33727-0466-4f83-8b5b-c44a4bd0dafb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 Sep 23 00:20:09 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" acquired by "delete_volume" :: waited 0.096s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a78c6e-ab01-4ccc-96ce-8d91d57112e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df Sep 23 00:20:09 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" returned: 0 in 0.952s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3 Sep 23 00:20:10 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df" returned: 0 in 0.631s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df Sep 23 00:20:10 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3" released by "delete_volume" :: held 1.623s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Created reservations ['cd168f19-77e4-4fbb-a497-2254f07e8bef', 'fca47fad-1046-4e6a-82eb-269382098ab7', '9431efa3-9ef5-49a8-82ac-84126666f505', 'b3a04d52-0f9b-4344-9f06-db0b3dda8f52'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-279f2edb-edc8-4011-b5c7-ebf4b797d1df" returned: 0 in 0.625s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:11 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-279f2edb-edc8-4011-b5c7-ebf4b797d1df" released by "delete_volume" :: held 1.425s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ab984-6ff1-413e-8b61-8649d175b49d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:11 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 Sep 23 00:20:11 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.547s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Deleted volume successfully. Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-037c9d99-03cf-4241-981d-cc4c89a51da4 tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-2a4fd6a2-e81e-452c-a0f2-415a07b8a7d3-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-4243a62e-e23f-4637-addc-68d289b828d1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-4243a62e-e23f-4637-addc-68d289b828d1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "cinder-quobyte-4243a62e-e23f-4637-addc-68d289b828d1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-4243a62e-e23f-4637-addc-68d289b828d1" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e615e3-a328-4ce3-a7e1-8f0a5cc65774]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:11 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266" returned: 0 in 0.654s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:11 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266 Sep 23 00:20:11 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 Sep 23 00:20:11 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dc89617d-7c90-468a-893d-5ba12f32b266" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-dc89617d-7c90-468a-893d-5ba12f32b266" released by "delete_volume" :: held 1.092s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['468468a7-3b3b-4907-8c1d-c02a00466fcc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:12 devstack cinder-volume[87132]: WARNING cinder.quota [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1322510186 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1322510186, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:12 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['4ed60af0-0346-40bc-a53f-7ea1175f1fe0', '1843ab53-0841-40d3-a249-252c8094031f', 'e15257f7-deca-4e07-a2f3-a479e4b577df', '13ad0307-4fe6-4245-bad6-d79ce2164866'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:12 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1 Sep 23 00:20:12 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['7dcbaab1-05f4-455f-8e12-91f8633e8929', 'f1f6dd90-ed93-421b-afd0-677902091e62', '46f7e6dd-b035-4f68-be28-01190d05a488', '2a2da9a7-a532-4f6f-a441-1330084e01b3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:12 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4243a62e-e23f-4637-addc-68d289b828d1" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-quobyte-4243a62e-e23f-4637-addc-68d289b828d1" released by "delete_volume" :: held 0.922s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:12 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Created reservations ['32232aab-9ee7-4b40-a96a-eeceee5c3586', '86bcc5f8-655c-4f1e-bc53-d4957f7ea619', 'b0f1ebac-9909-44fe-8b27-3b792f7b4755', '37fd5510-81f7-4108-bcd9-dee17db7d116'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:12 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:13 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.367s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-59401cfd-eca9-4a29-9565-1245945e8bc7 tempest-GroupSnapshotsTest-407265377 None] Delete group completed successfully. Sep 23 00:20:13 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Deleted volume successfully. Sep 23 00:20:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-cbbba60e-26bb-4548-b45e-9ea8f51a9abc tempest-AttachVolumeTestJSON-1274710783 None] Lock "cinder-4243a62e-e23f-4637-addc-68d289b828d1-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cd48790c-bc19-4738-b6f3-946007792801 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-865588741: creating Sep 23 00:20:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cd48790c-bc19-4738-b6f3-946007792801 tempest-GroupSnapshotsTest-407265377 None] Group tempest-GroupSnapshotsTest-Group-865588741: created successfully Sep 23 00:20:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cd48790c-bc19-4738-b6f3-946007792801 tempest-GroupSnapshotsTest-407265377 None] Create group completed successfully. Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (b80e84f1-1bed-4e5a-92e6-507bc3be496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7363ff5-bd2f-4e4c-a8e3-ec380d877c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7363ff5-bd2f-4e4c-a8e3-ec380d877c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851530498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fea3dddb-bca0-4ffc-85b0-82ce84e6d7ea,host='devstack@QuobyteHD#QuobyteHD',id=5389e8e5-f033-4858-909d-22272e90c6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:16Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25c0bab7-0252-4c59-af87-7adfdf4f63ca),volume_type_id=25c0bab7-0252-4c59-af87-7adfdf4f63ca)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73c9443-f4a7-4dcd-b477-70ba0646dbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73c9443-f4a7-4dcd-b477-70ba0646dbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db54d7ab-3cfe-488b-a4af-7891e3d4af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db54d7ab-3cfe-488b-a4af-7891e3d4af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5389e8e5-f033-4858-909d-22272e90c6d4', 'volume_name': 'volume-5389e8e5-f033-4858-909d-22272e90c6d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f310e6-a065-4b63-8d95-87376d1e57a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f310e6-a065-4b63-8d95-87376d1e57a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6d5e69-98eb-43ee-b8d6-930be2519035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Volume 5389e8e5-f033-4858-909d-22272e90c6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5389e8e5-f033-4858-909d-22272e90c6d4', 'volume_size': 1} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fea3dddb-bca0-4ffc-85b0-82ce84e6d7ea,created_at=2026-09-22T22:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851530498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fea3dddb-bca0-4ffc-85b0-82ce84e6d7ea,host='devstack@QuobyteHD#QuobyteHD',id=5389e8e5-f033-4858-909d-22272e90c6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4764385a9b0a485f981e6e4a44e9b517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:16Z,use_quota=True,user_id='bd851e581785411ab4e95ebf0930c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25c0bab7-0252-4c59-af87-7adfdf4f63ca),volume_type_id=25c0bab7-0252-4c59-af87-7adfdf4f63ca)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Creating volume 5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:20:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 1073741824 Sep 23 00:20:16 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 1073741824" returned: 0 in 0.657s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:17 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 Sep 23 00:20:17 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6d5e69-98eb-43ee-b8d6-930be2519035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5389e8e5-f033-4858-909d-22272e90c6d4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f428271c-7860-4984-982b-d0e3ca73e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Volume volume-5389e8e5-f033-4858-909d-22272e90c6d4 (5389e8e5-f033-4858-909d-22272e90c6d4): created successfully Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f428271c-7860-4984-982b-d0e3ca73e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Flow 'volume_create_manager' (b80e84f1-1bed-4e5a-92e6-507bc3be496c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b33d9473-83db-4354-ba73-f909a0c01969 tempest-GroupSnapshotsTest-407265377 None] Created volume successfully. Sep 23 00:20:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] GroupSnapshot b6953d88-155b-4a45-b0c0-d8c86db59888: creating. Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Group snapshot b6953d88-155b-4a45-b0c0-d8c86db59888: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Creating offline snapshot 9530b5a9-904c-497c-950a-525cdbbba9cc of volume 5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7f76f3-36dc-4a9f-a9d4-e6430831e83a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 Sep 23 00:20:19 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:19 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4" returned: 0 in 0.566s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc 1G Sep 23 00:20:19 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc 1G" returned: 0 in 0.590s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5389e8e5-f033-4858-909d-22272e90c6d4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5389e8e5-f033-4858-909d-22272e90c6d4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc Sep 23 00:20:20 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5389e8e5-f033-4858-909d-22272e90c6d4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc" returned: 0 in 0.514s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc Sep 23 00:20:20 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:21 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:21 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info Sep 23 00:20:21 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:22 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info Sep 23 00:20:22 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.info" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ba1b8edd-8797-40cf-ab7c-d2b8a529a1c5 tempest-GroupSnapshotsTest-407265377 None] group_snapshot b6953d88-155b-4a45-b0c0-d8c86db59888: created successfully Sep 23 00:20:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] group_snapshot b6953d88-155b-4a45-b0c0-d8c86db59888: deleting Sep 23 00:20:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] group_snapshot b6953d88-155b-4a45-b0c0-d8c86db59888: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-9530b5a9-904c-497c-950a-525cdbbba9cc" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-9530b5a9-904c-497c-950a-525cdbbba9cc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Deleting offline snapshot 9530b5a9-904c-497c-950a-525cdbbba9cc of volume 5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] snapshot_file for this snap is: volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[50455448-24a0-4f27-a9f7-f3497fcff161]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc Sep 23 00:20:24 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc" returned: 0 in 0.665s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5389e8e5-f033-4858-909d-22272e90c6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ace1f39-3593-46f3-be4e-8331228dfbad]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 Sep 23 00:20:25 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:25 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc Sep 23 00:20:25 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc" returned: 0 in 0.813s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc Sep 23 00:20:26 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-10fefc7d-cbbb-468d-ba88-37a83cea7974 req-c518634c-0382-4565-b57e-37544cd7125f tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-10fefc7d-cbbb-468d-ba88-37a83cea7974 req-c518634c-0382-4565-b57e-37544cd7125f tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-10fefc7d-cbbb-468d-ba88-37a83cea7974 req-c518634c-0382-4565-b57e-37544cd7125f tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-10fefc7d-cbbb-468d-ba88-37a83cea7974 req-c518634c-0382-4565-b57e-37544cd7125f tempest-TestServerVolumeAttachmentScenario-1941076495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-fcbc2ffa-5918-474d-955d-82f927125975', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a635cc5-749f-465e-9e39-cbe672217fe3', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:26 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4.9530b5a9-904c-497c-950a-525cdbbba9cc" returned: 0 in 0.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-9530b5a9-904c-497c-950a-525cdbbba9cc" released by "_delete_snapshot" :: held 2.841s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" released by "delete_snapshot" :: held 2.881s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-10fefc7d-cbbb-468d-ba88-37a83cea7974 req-c518634c-0382-4565-b57e-37544cd7125f tempest-TestServerVolumeAttachmentScenario-1941076495 None] attachment_update completed successfully. Sep 23 00:20:27 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-759935372 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-759935372, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:27 devstack cinder-volume[87132]: WARNING cinder.quota [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-759935372 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-759935372, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['ae65ff33-c12e-437f-8b8a-c3ea0da4051b', '66beb4c8-a897-40c0-abf5-b25e407b0936', '2849a404-ea99-4099-b3f0-da2ae2990d5a', 'e3c11e9e-b95c-4f42-81e9-6594ebb08dd4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e3a50155-791b-49c0-8ddb-a7bdfd30ad58 tempest-GroupSnapshotsTest-407265377 None] group_snapshot b6953d88-155b-4a45-b0c0-d8c86db59888: deleted successfully Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[014be829-be0d-4b34-8925-74e86f260f06]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 Sep 23 00:20:28 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:28 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4" returned: 0 in 0.699s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4 Sep 23 00:20:28 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Flow 'volume_create_manager' (97b6c3e4-6ad8-42e2-bc26-9a07ee604385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91ccf0b-4457-4151-8e65-efab8c6480f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91ccf0b-4457-4151-8e65-efab8c6480f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975890197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2849a640-56be-4a0d-b06e-a84134391e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba74f819c42f460dba568996a171c449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:29Z,use_quota=True,user_id='c53a6d17db7845f2bef16be1e123e0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c913c94-9e01-41db-b3de-5ff688c6b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c913c94-9e01-41db-b3de-5ff688c6b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc03a00-11f3-4c86-8277-159e983894a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc03a00-11f3-4c86-8277-159e983894a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2849a640-56be-4a0d-b06e-a84134391e0b', 'volume_name': 'volume-2849a640-56be-4a0d-b06e-a84134391e0b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1d9364-0a66-4f5a-a82a-a81fe34bd973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1d9364-0a66-4f5a-a82a-a81fe34bd973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54baad09-de69-4826-b871-335e224b184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Volume 2849a640-56be-4a0d-b06e-a84134391e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2849a640-56be-4a0d-b06e-a84134391e0b', 'volume_size': 1} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-975890197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2849a640-56be-4a0d-b06e-a84134391e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba74f819c42f460dba568996a171c449',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:29Z,use_quota=True,user_id='c53a6d17db7845f2bef16be1e123e0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Creating volume 2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b 1073741824 Sep 23 00:20:29 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5389e8e5-f033-4858-909d-22272e90c6d4" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Lock "cinder-quobyte-5389e8e5-f033-4858-909d-22272e90c6d4" released by "delete_volume" :: held 1.388s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['c22b66b0-579f-47b6-a955-bdbe5d371cfb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:29 devstack cinder-volume[87132]: WARNING cinder.quota [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-759935372 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-759935372, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Created reservations ['879898bf-52f5-4996-8d72-e34cfaa551e9', '102796b1-9228-4881-9e14-e5f58a4132a0', '7b5ff15a-39ea-45d7-b583-3ebb15997546', '60a262b2-8bca-488e-a77c-b30c727f774b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:29 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b 1073741824" returned: 0 in 0.693s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:30 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:20:30 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.304s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a3a33beb-d727-4b78-9d7e-d774c01d0c17 tempest-GroupSnapshotsTest-407265377 None] Delete group completed successfully. Sep 23 00:20:30 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.314s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54baad09-de69-4826-b871-335e224b184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2849a640-56be-4a0d-b06e-a84134391e0b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379ff9ca-28ff-445e-b449-27280804db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Volume volume-2849a640-56be-4a0d-b06e-a84134391e0b (2849a640-56be-4a0d-b06e-a84134391e0b): created successfully Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379ff9ca-28ff-445e-b449-27280804db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Flow 'volume_create_manager' (97b6c3e4-6ad8-42e2-bc26-9a07ee604385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5c091dca-fa83-4824-96bf-c2b343719e5e tempest-VolumesActionsTest-1939702556 None] Created volume successfully. Sep 23 00:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-429f25fc-a413-42f2-b4e3-b914b32edbed req-a8066e9d-f0ea-424b-97c3-c4fb8c1da851 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-429f25fc-a413-42f2-b4e3-b914b32edbed req-a8066e9d-f0ea-424b-97c3-c4fb8c1da851 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-429f25fc-a413-42f2-b4e3-b914b32edbed req-a8066e9d-f0ea-424b-97c3-c4fb8c1da851 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-429f25fc-a413-42f2-b4e3-b914b32edbed req-a8066e9d-f0ea-424b-97c3-c4fb8c1da851 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-1c5f950a-7619-4542-a495-4753158f37be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64ff25b1-84d2-4413-8960-935124b6044e', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-429f25fc-a413-42f2-b4e3-b914b32edbed req-a8066e9d-f0ea-424b-97c3-c4fb8c1da851 tempest-TestServerVolumeAttachmentScenario-1941076495 None] attachment_update completed successfully. Sep 23 00:20:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-8b7506e7-5a13-4857-9269-457e42ac59f8 req-1a2c4d79-d201-4e3e-9ef5-978308408ff4 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Terminate volume connection completed successfully. Sep 23 00:20:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-8b7506e7-5a13-4857-9269-457e42ac59f8 req-1a2c4d79-d201-4e3e-9ef5-978308408ff4 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Deleting attachment 64ff25b1-84d2-4413-8960-935124b6044e. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-47a86352-73df-474d-a99a-a4fbe5ef11bd req-73a83930-5243-4e98-9f81-cbad23efceea tempest-TestServerVolumeAttachmentScenario-1941076495 None] Terminate volume connection completed successfully. Sep 23 00:20:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-47a86352-73df-474d-a99a-a4fbe5ef11bd req-73a83930-5243-4e98-9f81-cbad23efceea tempest-TestServerVolumeAttachmentScenario-1941076495 None] Deleting attachment 8a635cc5-749f-465e-9e39-cbe672217fe3. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=88,cinder:SELECT=88,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "cinder-1c5f950a-7619-4542-a495-4753158f37be-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-1c5f950a-7619-4542-a495-4753158f37be-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "cinder-quobyte-1c5f950a-7619-4542-a495-4753158f37be" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-quobyte-1c5f950a-7619-4542-a495-4753158f37be" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f668fa-fa5b-425d-b23c-2a5bef02d4d7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be Sep 23 00:20:48 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be" returned: 0 in 0.804s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be Sep 23 00:20:48 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1c5f950a-7619-4542-a495-4753158f37be" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-quobyte-1c5f950a-7619-4542-a495-4753158f37be" released by "delete_volume" :: held 1.360s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Created reservations ['8f476f1f-caa4-4aa2-b49e-0593a237eaac', '59835967-9d03-4c5a-82f9-ce8f5d7af004', 'ec77f829-c6f1-4908-b1b4-1e25cb7fdd31', 'af240035-287e-40f5-81bb-de7ec0b5fd33'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:49 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:49 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:49 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Deleted volume successfully. Sep 23 00:20:49 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c881fd40-81bc-44e2-89f3-5ea4efdf284a tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-1c5f950a-7619-4542-a495-4753158f37be-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:49 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faa5db98-30ae-48b1-a531-155316da3f48 tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "cinder-fcbc2ffa-5918-474d-955d-82f927125975-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faa5db98-30ae-48b1-a531-155316da3f48 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" acquired by "attach_volume" :: waited 0.067s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-fcbc2ffa-5918-474d-955d-82f927125975-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.620s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-faa5db98-30ae-48b1-a531-155316da3f48 tempest-VolumesActionsTest-1939702556 None] Attaching volume 2849a640-56be-4a0d-b06e-a84134391e0b to instance a213a39c-aebd-4003-b7f3-5b4a3dd7abc3 at mountpoint /dev/vdb on host None. Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "cinder-quobyte-fcbc2ffa-5918-474d-955d-82f927125975" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-quobyte-fcbc2ffa-5918-474d-955d-82f927125975" acquired by "delete_volume" :: waited 0.068s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-faa5db98-30ae-48b1-a531-155316da3f48 tempest-VolumesActionsTest-1939702556 None] Attach volume completed successfully. Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faa5db98-30ae-48b1-a531-155316da3f48 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" released by "attach_volume" :: held 0.347s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c1edca-4427-4222-a113-25df0ed2ff39]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-267fc09f-679d-4c31-8130-8e77af2ed35e tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-267fc09f-679d-4c31-8130-8e77af2ed35e tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-267fc09f-679d-4c31-8130-8e77af2ed35e tempest-VolumesActionsTest-1939702556 None] Detaching volume 2849a640-56be-4a0d-b06e-a84134391e0b from instance a213a39c-aebd-4003-b7f3-5b4a3dd7abc3. Sep 23 00:20:50 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 Sep 23 00:20:50 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-267fc09f-679d-4c31-8130-8e77af2ed35e tempest-VolumesActionsTest-1939702556 None] Detach volume completed successfully. Sep 23 00:20:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-267fc09f-679d-4c31-8130-8e77af2ed35e tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:51 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975" returned: 0 in 0.942s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:51 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975 Sep 23 00:20:51 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:52 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fcbc2ffa-5918-474d-955d-82f927125975" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-quobyte-fcbc2ffa-5918-474d-955d-82f927125975" released by "delete_volume" :: held 1.435s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Created reservations ['2e481eef-f5f3-421c-b232-4572938d5a37', '5b84588f-c2b0-42d4-993c-d7762933aba4', 'a4a45a9f-168b-4af1-a116-455732ce35b0', 'f8b961b7-e117-47b2-98fa-ccebbdcb2230'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:52 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:20:52 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:53 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.466s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Deleted volume successfully. Sep 23 00:20:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-58460c70-ee3f-43a3-ac47-3a80db644250 tempest-TestServerVolumeAttachmentScenario-1941076495 None] Lock "cinder-fcbc2ffa-5918-474d-955d-82f927125975-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Flow 'volume_create_manager' (d07ca688-26b7-41bb-a734-863f52dd14f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b81386-5fcf-4fb4-b4d4-6bb7d82881c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b81386-5fcf-4fb4-b4d4-6bb7d82881c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1064400608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100103cd-18db-4ba2-b71e-d280ba9a16ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a099f328f96493193db3e3ccfcb601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='422bbbf66f6344bfb00ffae9dd520931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8059a1-16c6-44d4-b59d-718d537eb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8059a1-16c6-44d4-b59d-718d537eb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963dd8a6-e9bc-410c-9249-b2db99687c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963dd8a6-e9bc-410c-9249-b2db99687c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100103cd-18db-4ba2-b71e-d280ba9a16ae', 'volume_name': 'volume-100103cd-18db-4ba2-b71e-d280ba9a16ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ee93b5-cc79-4248-aa3f-e2f1aed5d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ee93b5-cc79-4248-aa3f-e2f1aed5d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad89bbe-5c07-45a1-a7e2-7bbca1a15b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Volume 100103cd-18db-4ba2-b71e-d280ba9a16ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100103cd-18db-4ba2-b71e-d280ba9a16ae', 'volume_size': 1} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1064400608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100103cd-18db-4ba2-b71e-d280ba9a16ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a099f328f96493193db3e3ccfcb601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='422bbbf66f6344bfb00ffae9dd520931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Creating volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:20:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:58 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae 1073741824 Sep 23 00:20:58 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae 1073741824" returned: 0 in 0.688s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:59 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae Sep 23 00:20:59 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad89bbe-5c07-45a1-a7e2-7bbca1a15b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100103cd-18db-4ba2-b71e-d280ba9a16ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e3f4bd-50ab-4755-aca6-f607aff58873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Volume volume-100103cd-18db-4ba2-b71e-d280ba9a16ae (100103cd-18db-4ba2-b71e-d280ba9a16ae): created successfully Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e3f4bd-50ab-4755-aca6-f607aff58873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Flow 'volume_create_manager' (d07ca688-26b7-41bb-a734-863f52dd14f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-38b02f16-871d-445b-9d98-e3befebc91cd tempest-SnapshotsActionsTest-84416767 None] Created volume successfully. Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=113,cinder:UPDATE=128,cinder:INSERT=27,cinder:DELETE=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Creating offline snapshot 702867b9-6a2a-41ab-b261-ac2a81f553da of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d47b309-b701-457f-bcfe-1dd726526305]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae Sep 23 00:21:01 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae" returned: 0 in 1.172s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:02 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da 1G Sep 23 00:21:02 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:03 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da 1G" returned: 0 in 1.138s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:03 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:03 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:04 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.654s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da is being set with open permissions: ugo+rw Sep 23 00:21:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:04 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:04 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.633s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info Sep 23 00:21:05 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info" returned: 0 in 0.773s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info is being set with open permissions: ugo+rw Sep 23 00:21:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info Sep 23 00:21:05 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.info" returned: 0 in 0.570s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.180s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8d87fc8a-dc29-413d-9b50-ed5fb61921c9 tempest-SnapshotsActionsTest-84416767 None] Create snapshot completed successfully Sep 23 00:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Creating offline snapshot c6f23b73-ed33-492f-9b6f-ff5dfccb0acf of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceacb080-ad2c-4bb0-a881-76cf7231d6e4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:08 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:08 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:08 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:08 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf 1G Sep 23 00:21:08 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf 1G" returned: 0 in 0.969s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:09 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf Sep 23 00:21:09 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf is being set with open permissions: ugo+rw Sep 23 00:21:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:10 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf Sep 23 00:21:10 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:10 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8a98e70c-7546-40f3-a76e-5b19f2894399 tempest-SnapshotsActionsTest-84416767 None] Create snapshot completed successfully Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Deleting offline snapshot c6f23b73-ed33-492f-9b6f-ff5dfccb0acf of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] snapshot_file for this snap is: volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a63971-54ca-495a-b18f-f6acadaf30dd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:11 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf Sep 23 00:21:11 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:12 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed1710-3b19-4f9b-92db-3e8309ea397a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:12 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:12 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:13 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.706s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:13 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf Sep 23 00:21:13 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:13 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" returned: 0 in 0.868s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:13 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf Sep 23 00:21:13 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:14 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" returned: 0 in 0.780s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf" released by "_delete_snapshot" :: held 3.154s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_snapshot" :: held 3.219s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:14 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Created reservations ['9ef8a44b-97e1-405d-9879-47018937a945', 'ccaf4a9b-2ac1-4b87-a882-2bc72c583848', '9830fd6b-6bcc-4cdd-bd5b-616595d9cb27', 'e64d7c2a-0da6-46a1-b5e7-26bf06dad45d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Delete snapshot completed successfully. Sep 23 00:21:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-13f03c23-6df8-4b73-bade-54cce3afc922 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-c6f23b73-ed33-492f-9b6f-ff5dfccb0acf-delete_snapshot" released by "delete_snapshot" :: held 3.680s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Creating offline snapshot 75c72b7b-4bb4-4daa-b169-c1462b13b42b of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[887dfe79-b712-431f-8015-0b6f34c51056]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:17 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:17 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:18 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:18 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b 1G Sep 23 00:21:18 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:18 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b 1G" returned: 0 in 0.801s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:18 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b Sep 23 00:21:18 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7760b12-608f-4e35-9b5a-db0acf5e5779 tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" by "attach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7760b12-608f-4e35-9b5a-db0acf5e5779 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" acquired by "attach_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b7760b12-608f-4e35-9b5a-db0acf5e5779 tempest-VolumesActionsTest-1939702556 None] Attaching volume 2849a640-56be-4a0d-b06e-a84134391e0b to instance c3bde624-0a53-4ea8-b23e-88af5a712f25 at mountpoint /dev/vdb on host None. Sep 23 00:21:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b7760b12-608f-4e35-9b5a-db0acf5e5779 tempest-VolumesActionsTest-1939702556 None] Attach volume completed successfully. Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b7760b12-608f-4e35-9b5a-db0acf5e5779 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b" released by "attach_volume" :: held 0.171s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:19 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b is being set with open permissions: ugo+rw Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:19 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b Sep 23 00:21:19 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:19 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30b96063-c9bd-4011-83bf-8617fa93233a tempest-SnapshotsActionsTest-84416767 None] Create snapshot completed successfully Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db082b8d-67f3-4f76-a14a-07079941a1e7 tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" by "detach_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db082b8d-67f3-4f76-a14a-07079941a1e7 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-db082b8d-67f3-4f76-a14a-07079941a1e7 tempest-VolumesActionsTest-1939702556 None] Detaching volume 2849a640-56be-4a0d-b06e-a84134391e0b from instance c3bde624-0a53-4ea8-b23e-88af5a712f25. Sep 23 00:21:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-db082b8d-67f3-4f76-a14a-07079941a1e7 tempest-VolumesActionsTest-1939702556 None] Detach volume completed successfully. Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-db082b8d-67f3-4f76-a14a-07079941a1e7 tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-75c72b7b-4bb4-4daa-b169-c1462b13b42b-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-75c72b7b-4bb4-4daa-b169-c1462b13b42b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-75c72b7b-4bb4-4daa-b169-c1462b13b42b" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-75c72b7b-4bb4-4daa-b169-c1462b13b42b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Deleting offline snapshot 75c72b7b-4bb4-4daa-b169-c1462b13b42b of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] snapshot_file for this snap is: volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994b525-03ef-4624-b4b6-09776ae805a1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:21 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b Sep 23 00:21:21 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:21 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ac1ab-5baa-46ec-abf8-297628702db5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:21 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:21 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:22 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:22 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b Sep 23 00:21:22 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:22 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:22 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b Sep 23 00:21:22 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:23 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.75c72b7b-4bb4-4daa-b169-c1462b13b42b" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-75c72b7b-4bb4-4daa-b169-c1462b13b42b" released by "_delete_snapshot" :: held 2.415s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_snapshot" :: held 2.463s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:23 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Created reservations ['e497a42b-2451-49ac-8e05-573dfb729c63', '9612721d-03bc-47d6-b77b-5291fc0842df', 'becd8cd7-b159-4a41-b164-159e82bc0fcb', '927158d0-5470-4ac7-9531-de657d573221'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Delete snapshot completed successfully. Sep 23 00:21:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33b03f72-0180-47b2-a5b8-5a21d78245a7 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-75c72b7b-4bb4-4daa-b169-c1462b13b42b-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Creating offline snapshot ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a9281-85f9-4fbb-8c14-7a2d6e360c12]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:25 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 1G Sep 23 00:21:25 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:26 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 1G" returned: 0 in 0.743s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:26 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 Sep 23 00:21:26 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:26 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 is being set with open permissions: ugo+rw Sep 23 00:21:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:26 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 Sep 23 00:21:26 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:27 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.592s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d01968-2c8c-47be-8d9d-bf788521c58b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f8376f15-ec63-4c25-93a4-6069988ebb2f tempest-SnapshotsActionsTest-84416767 None] Create snapshot completed successfully Sep 23 00:21:27 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:21:27 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:27 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[450f85f7-aec2-4ee9-9b0b-1ac3d184dc2e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:27 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:21:27 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Deleting offline snapshot ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] snapshot_file for this snap is: volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b8a2d-206f-465e-b233-9a6ce917ba33]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:28 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.949cfb58-2120-477a-8c5c-5b4693e67590re1cu6my.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:28 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.949cfb58-2120-477a-8c5c-5b4693e67590re1cu6my.img Sep 23 00:21:28 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 Sep 23 00:21:28 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a5f8ed-c755-4414-9b81-9852c5343a96]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:21:29 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.924s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 Sep 23 00:21:29 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:31 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" returned: 0 in 1.481s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:31 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678 Sep 23 00:21:31 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:31 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" returned: 0 in 0.674s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678" released by "_delete_snapshot" :: held 3.925s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_snapshot" :: held 3.973s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Created reservations ['c40331ba-24c8-426d-808c-1e3c069d2b4d', '9280488d-aa3a-4ad8-9c4a-9b88897ae2c9', '7c39f935-0ced-4257-9c07-5e63a99af510', 'c07134d8-457a-42a0-934f-58e17ced2033'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Delete snapshot completed successfully. Sep 23 00:21:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-585293b2-3ce4-4072-8007-8a8683628b1b tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-ff2ecc2b-79a3-4c09-8910-2cc81d4f2678-delete_snapshot" released by "delete_snapshot" :: held 4.499s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (a6032122-4afd-4337-8460-f65a16fd6ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643b7ab8-f949-4a6b-832a-36b4cb31d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643b7ab8-f949-4a6b-832a-36b4cb31d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-965558951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e834184d-ca98-44f9-9a7c-b26a6828ab33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e382512-f997-430c-be6f-ed2dc0866bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e382512-f997-430c-be6f-ed2dc0866bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87af059e-df17-4aa2-806d-c5fab2411908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87af059e-df17-4aa2-806d-c5fab2411908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e834184d-ca98-44f9-9a7c-b26a6828ab33', 'volume_name': 'volume-e834184d-ca98-44f9-9a7c-b26a6828ab33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c31f18-58c5-4243-b203-dc3d0c0c00e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c31f18-58c5-4243-b203-dc3d0c0c00e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194302bd-b5df-4afb-9f40-067428db74da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Volume e834184d-ca98-44f9-9a7c-b26a6828ab33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e834184d-ca98-44f9-9a7c-b26a6828ab33', 'volume_size': 1} Sep 23 00:21:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:37 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.949cfb58-2120-477a-8c5c-5b4693e67590re1cu6my.img" returned: 0 in 9.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f5def-0d38-46f5-a894-a06984203910]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:37 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:21:37 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:38 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:38 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.949cfb58-2120-477a-8c5c-5b4693e67590re1cu6my.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:21:38 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Converted 1024.00 MB image at 109.31 MB/s Sep 23 00:21:38 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] 949cfb58-2120-477a-8c5c-5b4693e67590 was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:21:48 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=31,cinder:UPDATE=25,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:48 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=55,cinder:INSERT=9,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:49 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:21:49 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:50 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.707s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Flow 'volume_create_manager' (e89a3db5-148b-4b7c-a665-e10f7d30c5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01684961-e0f8-4aff-8d12-bfce50a1ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01684961-e0f8-4aff-8d12-bfce50a1ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1802077006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3142e665-beae-4521-a29a-c0cadc14ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1630cf636b124471acc9295e6e1a51dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='f75a02336eb840c08d34b3810e8f11d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c11dac-5579-42e5-8ee2-ed9649c30830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c11dac-5579-42e5-8ee2-ed9649c30830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65526b70-c03e-437a-bd33-8af1f74ee484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65526b70-c03e-437a-bd33-8af1f74ee484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3142e665-beae-4521-a29a-c0cadc14ad0a', 'volume_name': 'volume-3142e665-beae-4521-a29a-c0cadc14ad0a', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67b7e5d-6fe6-48a4-a13e-ba816b266593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67b7e5d-6fe6-48a4-a13e-ba816b266593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97ab534-c299-42e1-8ec4-feeae733ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Volume 3142e665-beae-4521-a29a-c0cadc14ad0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3142e665-beae-4521-a29a-c0cadc14ad0a', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Trying to clone 3142e665-beae-4521-a29a-c0cadc14ad0a from image 7ff22cbd-c151-45fd-8a05-f05c376811bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:22:00 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b60ccf-c4bc-47f9-a9f2-2b0cf3394b65]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD Sep 23 00:22:00 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:01 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc is fetched for user f75a02336eb840c08d34b3810e8f11d3. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c1249-cbc0-4b43-9a85-59cf9f275b07]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:01 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD Sep 23 00:22:01 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:01 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.312s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Uploaded volume to glance image-id: 949cfb58-2120-477a-8c5c-5b4693e67590. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 31.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Creating offline snapshot 81b0bf23-b673-4d41-9c12-0ae6fe1666f8 of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30c78eee-89d7-4306-9769-6a7b4b5f5c23 tempest-VolumesActionsTest-1939702556 None] Copy volume to image completed successfully. Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c0306d-90e2-44a0-bddc-103449c3db00]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:04 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:22:04 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 1G Sep 23 00:22:05 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 1G" returned: 0 in 0.638s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 Sep 23 00:22:05 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:06 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:06 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 is being set with open permissions: ugo+rw Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:06 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 Sep 23 00:22:06 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.139s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-965558951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e834184d-ca98-44f9-9a7c-b26a6828ab33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:34Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Creating volume e834184d-ca98-44f9-9a7c-b26a6828ab33 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:22:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:06 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 1073741824 Sep 23 00:22:06 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a31c2d13-ca26-4263-9111-30fbb1ae2624 tempest-SnapshotsActionsTest-84416767 None] Create snapshot completed successfully Sep 23 00:22:07 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 1073741824" returned: 0 in 0.639s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 Sep 23 00:22:07 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-81b0bf23-b673-4d41-9c12-0ae6fe1666f8-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-81b0bf23-b673-4d41-9c12-0ae6fe1666f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Acquiring lock "cinder-quobyte-81b0bf23-b673-4d41-9c12-0ae6fe1666f8" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-81b0bf23-b673-4d41-9c12-0ae6fe1666f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Deleting offline snapshot 81b0bf23-b673-4d41-9c12-0ae6fe1666f8 of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] snapshot_file for this snap is: volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a206f7b-c0bf-4a59-b519-3de139d73ef0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.324s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1802077006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3142e665-beae-4521-a29a-c0cadc14ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1630cf636b124471acc9295e6e1a51dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:00Z,use_quota=True,user_id='f75a02336eb840c08d34b3810e8f11d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Creating volume 3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1073741824 Sep 23 00:22:08 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194302bd-b5df-4afb-9f40-067428db74da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e834184d-ca98-44f9-9a7c-b26a6828ab33', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee0c739-fc4c-4c2b-bbf3-c4f60aa3aea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Volume volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 (e834184d-ca98-44f9-9a7c-b26a6828ab33): created successfully Sep 23 00:22:08 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 Sep 23 00:22:08 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee0c739-fc4c-4c2b-bbf3-c4f60aa3aea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (a6032122-4afd-4337-8460-f65a16fd6ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f205db2f-f103-4666-8519-4bc7af6c7f6a tempest-AttachVolumeNegativeTest-933588799 None] Created volume successfully. Sep 23 00:22:08 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c99948-3aab-461e-bef0-75839b620fb8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:22:08 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1073741824" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a Sep 23 00:22:08 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 Sep 23 00:22:09 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.981s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b05c196-97ff-4830-831a-f9f3c54ced97]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Attempting download of 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 3142e665-beae-4521-a29a-c0cadc14ad0a. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab21f5-8b3f-4c7e-8345-99d087dd90ff]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:22:09 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n Sep 23 00:22:09 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8" returned: 0 in 0.691s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8 Sep 23 00:22:09 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n" returned: 0 in 0.574s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.709s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d28ab2f3-742e-40ec-a0fa-a77f92a07cbe req-747c6003-e913-4d45-97e3-d3e7188b6e5f tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ecfa25-c6f1-44a1-8e6d-0c703513f4f3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:22:10 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n Sep 23 00:22:10 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.81b0bf23-b673-4d41-9c12-0ae6fe1666f8" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-81b0bf23-b673-4d41-9c12-0ae6fe1666f8" released by "_delete_snapshot" :: held 2.207s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_snapshot" :: held 2.230s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Created reservations ['10b9c587-ce53-43d6-a69d-60aec59a396a', '82f75323-aa70-48b2-9bc4-ba4dab595414', '59a5af45-b0a8-419b-a296-5a91cec697b3', '3ccd4257-824d-4d97-a1ae-f0f10c3f1c38'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Delete snapshot completed successfully. Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3b21401a-d835-4c8a-94c3-d07cdf38cc06 tempest-SnapshotsActionsTest-330175550 None] Lock "cinder-81b0bf23-b673-4d41-9c12-0ae6fe1666f8-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:10 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n" returned: 1 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_93k6296n' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51350ca-50e5-4459-9ba1-57ea34fb1896]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.489s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img Sep 23 00:22:10 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD Sep 23 00:22:10 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] 7ff22cbd-c151-45fd-8a05-f05c376811bc was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:22:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a Sep 23 00:22:10 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "cinder-702867b9-6a2a-41ab-b261-ac2a81f553da-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-702867b9-6a2a-41ab-b261-ac2a81f553da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "cinder-quobyte-702867b9-6a2a-41ab-b261-ac2a81f553da" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-702867b9-6a2a-41ab-b261-ac2a81f553da" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Deleting offline snapshot 702867b9-6a2a-41ab-b261-ac2a81f553da of volume 100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] snapshot_file for this snap is: volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3566ed9f-7779-4282-b662-cbdc5110a12d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:22:13 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.967s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100103cd-18db-4ba2-b71e-d280ba9a16ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5dc63-91f2-4d56-a7f1-08925d681ffb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae Sep 23 00:22:14 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae" returned: 0 in 0.985s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:22:15 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 1.047s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da Sep 23 00:22:16 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:17 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae.702867b9-6a2a-41ab-b261-ac2a81f553da" returned: 0 in 0.605s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-702867b9-6a2a-41ab-b261-ac2a81f553da" released by "_delete_snapshot" :: held 3.976s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_snapshot" :: held 4.029s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Created reservations ['185733d4-3640-487f-baeb-8ad61d1e9d4e', '84083c74-b642-44aa-8a44-5f833e23129b', 'dad4e4e4-7d95-4c2d-b634-72aff66f826d', '3d45d288-c3e7-497f-a2c3-7cc349bc1ad3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Delete snapshot completed successfully. Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-25b86fae-cbc6-4ae1-b348-59013d1eb789 tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-702867b9-6a2a-41ab-b261-ac2a81f553da-delete_snapshot" released by "delete_snapshot" :: held 4.387s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:17 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a" returned: 0 in 6.688s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_ehe4yxiedevstack@QuobyteHD, size 112.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:17 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Converted 112.00 MB image at 16.74 MB/s Sep 23 00:22:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:17 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1G Sep 23 00:22:17 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "cinder-100103cd-18db-4ba2-b71e-d280ba9a16ae-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-100103cd-18db-4ba2-b71e-d280ba9a16ae-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c89ff-d090-4519-a287-8dd48e514287]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae Sep 23 00:22:18 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a 1G" returned: 0 in 1.032s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Downloaded image 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume 3142e665-beae-4521-a29a-c0cadc14ad0a successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc for user f75a02336eb840c08d34b3810e8f11d3 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Marking volume 3142e665-beae-4521-a29a-c0cadc14ad0a as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Copying metadata from image 7ff22cbd-c151-45fd-8a05-f05c376811bc to 3142e665-beae-4521-a29a-c0cadc14ad0a. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Creating volume glance metadata for volume 3142e665-beae-4521-a29a-c0cadc14ad0a backed by image 7ff22cbd-c151-45fd-8a05-f05c376811bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97ab534-c299-42e1-8ec4-feeae733ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3142e665-beae-4521-a29a-c0cadc14ad0a', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a938d9-85aa-4f5f-a7d1-82caaa2639de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Volume volume-3142e665-beae-4521-a29a-c0cadc14ad0a (3142e665-beae-4521-a29a-c0cadc14ad0a): created successfully Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a938d9-85aa-4f5f-a7d1-82caaa2639de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Flow 'volume_create_manager' (e89a3db5-148b-4b7c-a665-e10f7d30c5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6fcea815-c629-4487-99f7-e300434af26e tempest-TestShelveInstance-1897680355 None] Created volume successfully. Sep 23 00:22:19 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae" returned: 0 in 0.782s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae Sep 23 00:22:19 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-100103cd-18db-4ba2-b71e-d280ba9a16ae" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-quobyte-100103cd-18db-4ba2-b71e-d280ba9a16ae" released by "delete_volume" :: held 1.491s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Created reservations ['f2c6ca79-b832-4070-a5e8-a52177101a4f', 'e6014b1f-3d4a-4fcf-a69f-7aa29758255b', '6a4d671b-df66-4535-87f4-9933572a63c9', '57c43290-9a82-40cf-b226-791dd192fc18'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:19 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img" returned: 0 in 9.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f98ac-c936-4f4b-bc19-51519ca5f5f3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:22:20 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:22:20 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Deleted volume successfully. Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d5cc9953-a0d0-4037-aa5c-f5aa236afc9c tempest-SnapshotsActionsTest-84416767 None] Lock "cinder-100103cd-18db-4ba2-b71e-d280ba9a16ae-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.679s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:20 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Converted 1024.00 MB image at 108.20 MB/s Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] 644542f2-4b58-44f2-8de7-9b1436692d4a was raw, converting to qcow2 {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7ca96-cf3f-4a10-acf1-664e241d85ec]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img Sep 23 00:22:20 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:21 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img Sep 23 00:22:21 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:21 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img" returned: 1 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img /opt/stack/data/cinder/conversion/vol_upload_scfr1okr {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img /opt/stack/data/cinder/conversion/vol_upload_scfr1okr Sep 23 00:22:21 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:21 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img /opt/stack/data/cinder/conversion/vol_upload_scfr1okr" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Image conversion details: src /opt/stack/data/cinder/conversion/2849a640-56be-4a0d-b06e-a84134391e0b.temp_image.644542f2-4b58-44f2-8de7-9b1436692d4ayhbmamx9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_scfr1okr {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:22:21 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89fcec4-0593-4412-b8b0-e83babab5806]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_scfr1okr {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_scfr1okr Sep 23 00:22:22 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_scfr1okr" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd60f520-4579-4ffd-8270-f6647f3e45af req-f497314e-3fe7-4046-888a-035eddf370e5 tempest-TestShelveInstance-1897680355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.037s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Uploaded volume to glance image-id: 644542f2-4b58-44f2-8de7-9b1436692d4a. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d28ab2f3-742e-40ec-a0fa-a77f92a07cbe req-747c6003-e913-4d45-97e3-d3e7188b6e5f tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.309s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-d28ab2f3-742e-40ec-a0fa-a77f92a07cbe req-747c6003-e913-4d45-97e3-d3e7188b6e5f tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd60f520-4579-4ffd-8270-f6647f3e45af req-f497314e-3fe7-4046-888a-035eddf370e5 tempest-TestShelveInstance-1897680355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.400s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5a702144-ca92-4239-af44-6eee1fab82be tempest-VolumesActionsTest-1939702556 None] Copy volume to image completed successfully. Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-fd60f520-4579-4ffd-8270-f6647f3e45af req-f497314e-3fe7-4046-888a-035eddf370e5 tempest-TestShelveInstance-1897680355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d28ab2f3-742e-40ec-a0fa-a77f92a07cbe req-747c6003-e913-4d45-97e3-d3e7188b6e5f tempest-AttachVolumeNegativeTest-933588799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-e834184d-ca98-44f9-9a7c-b26a6828ab33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ed7032d-0a0a-4468-ac3c-f59ab69cb751', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-fd60f520-4579-4ffd-8270-f6647f3e45af req-f497314e-3fe7-4046-888a-035eddf370e5 tempest-TestShelveInstance-1897680355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-3142e665-beae-4521-a29a-c0cadc14ad0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c862d2ff-531a-4440-a7bf-8ce67dd750cd', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d28ab2f3-742e-40ec-a0fa-a77f92a07cbe req-747c6003-e913-4d45-97e3-d3e7188b6e5f tempest-AttachVolumeNegativeTest-933588799 None] attachment_update completed successfully. Sep 23 00:22:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-fd60f520-4579-4ffd-8270-f6647f3e45af req-f497314e-3fe7-4046-888a-035eddf370e5 tempest-TestShelveInstance-1897680355 None] attachment_update completed successfully. Sep 23 00:22:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Acquiring lock "cinder-quobyte-2849a640-56be-4a0d-b06e-a84134391e0b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "cinder-quobyte-2849a640-56be-4a0d-b06e-a84134391e0b" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac78c2b-03f1-417c-a9ad-2db9e6e7e946]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:27 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:22:27 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:27 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:27 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b Sep 23 00:22:27 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2849a640-56be-4a0d-b06e-a84134391e0b" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "cinder-quobyte-2849a640-56be-4a0d-b06e-a84134391e0b" released by "delete_volume" :: held 1.137s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Created reservations ['b52428a8-d1da-4709-9448-4cb0f39874ac', '2e290157-0357-477d-8439-7206beec1aca', '5868714c-f67e-40b6-b0f3-eb5a7d9a694e', '0fcf593d-926b-4d9d-8b32-067b4163e520'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:28 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:22:28 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:29 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.601s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Deleted volume successfully. Sep 23 00:22:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-614e3295-b648-4c69-ab6c-50897df244ca tempest-VolumesActionsTest-1939702556 None] Lock "cinder-2849a640-56be-4a0d-b06e-a84134391e0b-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:38 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=50,cinder:INSERT=15,cinder:UPDATE=42,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=47,cinder:UPDATE=36,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:49 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:22:49 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Flow 'volume_create_manager' (21c60072-3c42-40c0-a687-b24b577fe43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21abec2-69e8-4e40-9878-b3ac828e4dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21abec2-69e8-4e40-9878-b3ac828e4dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2118714409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2cceb8-1f58-4d52-8f78-46dc1524862c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a937fa7b894a47a727479b695152e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:50Z,use_quota=True,user_id='6ce0243b5e9f4b6599abbc2db7642c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a94a2b-786e-462e-b7eb-61c4b9d56d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a94a2b-786e-462e-b7eb-61c4b9d56d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03799fa-9c54-4de2-b49a-05d19fd8dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03799fa-9c54-4de2-b49a-05d19fd8dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'volume_name': 'volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc3c029-af4c-4be4-9e8b-56d479a33317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc3c029-af4c-4be4-9e8b-56d479a33317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291df647-7221-4632-8f30-bdb18170214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:50 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Volume 4c2cceb8-1f58-4d52-8f78-46dc1524862c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'volume_size': 1} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2118714409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2cceb8-1f58-4d52-8f78-46dc1524862c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a937fa7b894a47a727479b695152e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:50Z,use_quota=True,user_id='6ce0243b5e9f4b6599abbc2db7642c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Creating volume 4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:50 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:50 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c 1073741824 Sep 23 00:22:50 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:50 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.481s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:22:51 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c 1073741824" returned: 0 in 1.107s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:51 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:22:51 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:51 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291df647-7221-4632-8f30-bdb18170214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca212873-f0f5-433a-a1a3-1abcac53c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Volume volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c (4c2cceb8-1f58-4d52-8f78-46dc1524862c): created successfully Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca212873-f0f5-433a-a1a3-1abcac53c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Flow 'volume_create_manager' (21c60072-3c42-40c0-a687-b24b577fe43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-75ced993-1a7e-4d91-803f-568ce8700df1 tempest-VolumesCloneTest-48682616 None] Created volume successfully. Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Flow 'volume_create_manager' (d710d9f8-1a8f-4ee6-8225-cce06a3d5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2133c8-53da-4c65-9719-69c2d1c46b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2133c8-53da-4c65-9719-69c2d1c46b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1358975774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff94104-7b82-4b53-8a4d-29d9dcfa7c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a937fa7b894a47a727479b695152e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4c2cceb8-1f58-4d52-8f78-46dc1524862c,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:53Z,use_quota=True,user_id='6ce0243b5e9f4b6599abbc2db7642c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d6bcfb-62d2-4d2f-b034-a402d7f4a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d6bcfb-62d2-4d2f-b034-a402d7f4a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1acefe-acae-411e-ad98-22730a8501c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1acefe-acae-411e-ad98-22730a8501c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7ff94104-7b82-4b53-8a4d-29d9dcfa7c98', 'volume_name': 'volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98', 'volume_size': 2, 'source_volid': '4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f33cc4-cc30-42e7-8c88-80fc5d5f9818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f33cc4-cc30-42e7-8c88-80fc5d5f9818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f879d7f7-207b-48d9-93d9-5ec385edb1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Volume 7ff94104-7b82-4b53-8a4d-29d9dcfa7c98: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98', 'volume_size': 2, 'source_volid': '4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'source_volstatus': 'available'} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:53 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Cloning volume 4c2cceb8-1f58-4d52-8f78-46dc1524862c to volume 7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Creating offline snapshot ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa of volume 4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e66693-9702-4cf0-86ff-488f3e0c714c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:53 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:22:53 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:54 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 1.012s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa 1G Sep 23 00:22:54 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:55 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa 1G" returned: 0 in 1.151s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:55 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:22:55 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:56 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa is being set with open permissions: ugo+rw Sep 23 00:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:56 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:22:56 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:56 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:56 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info Sep 23 00:22:56 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:57 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info is being set with open permissions: ugo+rw Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:57 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info Sep 23 00:22:57 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:57 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.info" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] snapshot: ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa, volume: 7ff94104-7b82-4b53-8a4d-29d9dcfa7c98, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89abf4-1d7b-4f52-82f2-3bfa4f280ce8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:58 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:22:58 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:58 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb6c98-e65f-4b88-a5eb-b840a3d8a108]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:58 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:22:58 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:58 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 0.540s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:22:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:58 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 Sep 23 00:22:58 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Flow 'volume_create_manager' (316e2ae6-b2e4-496f-9bbc-da7fa8309f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c48bff-88a3-4e80-8ecf-1864020f9eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c48bff-88a3-4e80-8ecf-1864020f9eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-927305566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9470c119-0d4e-466c-8471-0a0fddda2765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7cea64cfcd467f8b4df1bc5d5e8897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:06Z,use_quota=True,user_id='ffa0f585b5264cea90d67b5214b4d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33e37b16-7f9b-4013-8726-1a5fdb6cd6f3),volume_type_id=33e37b16-7f9b-4013-8726-1a5fdb6cd6f3)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a558ad2-5bef-4e0f-b07e-7bf05c5b88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a558ad2-5bef-4e0f-b07e-7bf05c5b88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc4ada0-5c13-46d6-99a7-5ea8666cbc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc4ada0-5c13-46d6-99a7-5ea8666cbc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9470c119-0d4e-466c-8471-0a0fddda2765', 'volume_name': 'volume-9470c119-0d4e-466c-8471-0a0fddda2765', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7c218-5d09-4190-9ca1-5d7458dfad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7c218-5d09-4190-9ca1-5d7458dfad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de0b1ff-16c3-4de7-b8c5-ba25ccc81b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Volume 9470c119-0d4e-466c-8471-0a0fddda2765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9470c119-0d4e-466c-8471-0a0fddda2765', 'volume_size': 1} Sep 23 00:23:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:08 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" returned: 0 in 9.503s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c, size 1024.00 MB, duration 9.50 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:08 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Converted 1024.00 MB image at 107.75 MB/s Sep 23 00:23:08 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 is being set with open permissions: ugo+rw Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 Sep 23 00:23:08 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:08 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" released by "_copy_volume_from_snapshot" :: held 10.912s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-quobyte-ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Deleting offline snapshot ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa of volume 4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] snapshot_file for this snap is: volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f02959b-a19c-4783-8904-5c46f31469fa]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:23:08 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[92276398-5e59-4244-8acd-df4c14427dd1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:09 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:23:09 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 0.560s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:09 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:23:09 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:10 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:10 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa Sep 23 00:23:10 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:10 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c.ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" returned: 0 in 0.279s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-ff3ba7db-ad36-4a44-8ce8-c7b6a66be2fa" released by "_delete_snapshot" :: held 1.715s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.069s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.846s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-927305566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9470c119-0d4e-466c-8471-0a0fddda2765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7cea64cfcd467f8b4df1bc5d5e8897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:06Z,use_quota=True,user_id='ffa0f585b5264cea90d67b5214b4d06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33e37b16-7f9b-4013-8726-1a5fdb6cd6f3),volume_type_id=33e37b16-7f9b-4013-8726-1a5fdb6cd6f3)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Creating volume 9470c119-0d4e-466c-8471-0a0fddda2765 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f879d7f7-207b-48d9-93d9-5ec385edb1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98', 'volume_size': 2, 'source_volid': '4c2cceb8-1f58-4d52-8f78-46dc1524862c', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5249c292-9370-4c41-8093-42212e84caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:10 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 1073741824 Sep 23 00:23:10 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Volume volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 (7ff94104-7b82-4b53-8a4d-29d9dcfa7c98): created successfully Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5249c292-9370-4c41-8093-42212e84caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Flow 'volume_create_manager' (d710d9f8-1a8f-4ee6-8225-cce06a3d5632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7c795654-51c4-43c7-a304-34e57af9fc64 tempest-VolumesCloneTest-48682616 None] Created volume successfully. Sep 23 00:23:10 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 1073741824" returned: 0 in 0.489s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:11 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 Sep 23 00:23:11 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:11 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de0b1ff-16c3-4de7-b8c5-ba25ccc81b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9470c119-0d4e-466c-8471-0a0fddda2765', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617b7fd5-b19c-4aea-8570-f96757976836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Volume volume-9470c119-0d4e-466c-8471-0a0fddda2765 (9470c119-0d4e-466c-8471-0a0fddda2765): created successfully Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617b7fd5-b19c-4aea-8570-f96757976836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Flow 'volume_create_manager' (316e2ae6-b2e4-496f-9bbc-da7fa8309f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2e9fd117-9591-4817-871c-02ec58cc17e2 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Created volume successfully. Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "cinder-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a220b4-9d8e-44b9-b852-a9b91ccf5b50]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:11 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 Sep 23 00:23:11 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98 Sep 23 00:23:12 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:12 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98" released by "delete_volume" :: held 1.094s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:12 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-297f032e-9e52-4dad-8d7d-7a7be462f52a tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Retype volume completed successfully. Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Created reservations ['4e0a3d70-cc77-4dda-8f30-85b5fcd494d4', '170193a3-0504-4f43-a1f0-398a121e731f', '706b9e63-aa98-4b11-af01-897907ae24fc', 'df1e4877-ae56-4238-90ed-746e72f1e87d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:13 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:13 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:13 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Deleted volume successfully. Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-102888a5-ee67-4340-9422-597d7e81f145 tempest-VolumesCloneTest-48682616 None] Lock "cinder-7ff94104-7b82-4b53-8a4d-29d9dcfa7c98-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "cinder-9470c119-0d4e-466c-8471-0a0fddda2765-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "cinder-9470c119-0d4e-466c-8471-0a0fddda2765-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "cinder-quobyte-9470c119-0d4e-466c-8471-0a0fddda2765" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "cinder-quobyte-9470c119-0d4e-466c-8471-0a0fddda2765" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3cf4e2-3bd8-4a4e-b3e5-26934ee48fa3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-4c2cceb8-1f58-4d52-8f78-46dc1524862c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "cinder-4c2cceb8-1f58-4d52-8f78-46dc1524862c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:14 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 Sep 23 00:23:14 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Acquiring lock "cinder-quobyte-4c2cceb8-1f58-4d52-8f78-46dc1524862c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-4c2cceb8-1f58-4d52-8f78-46dc1524862c" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8565d454-6538-434e-ae4a-4ceb1425120e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:23:14 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:14 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765" returned: 0 in 0.815s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765 Sep 23 00:23:14 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:14 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c Sep 23 00:23:14 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9470c119-0d4e-466c-8471-0a0fddda2765" returned: 0 in 0.401s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "cinder-quobyte-9470c119-0d4e-466c-8471-0a0fddda2765" released by "delete_volume" :: held 1.295s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:15 devstack cinder-volume[87132]: WARNING cinder.quota [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:15 devstack cinder-volume[87132]: WARNING cinder.quota [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Created reservations ['ad546c63-439e-4cb6-83fc-b65d76d93df4', 'f25c5976-22b8-4158-ae32-6a48dea4780e', '0bba85cd-697f-490f-be83-2aeb409f22e3', 'bdc328b3-a400-4589-93c2-55c3b38fc943'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:15 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4c2cceb8-1f58-4d52-8f78-46dc1524862c" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "cinder-quobyte-4c2cceb8-1f58-4d52-8f78-46dc1524862c" released by "delete_volume" :: held 1.071s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:15 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:15 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Created reservations ['866b5ab8-60e9-4e62-9320-8cd3a441998a', 'cb4de361-677a-46dd-a5ac-523cc2e4406e', '34df9051-9189-4591-aaff-d558c936ee68', '1c9898de-529e-4957-8a6e-27e87b654964'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:15 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:15 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Deleted volume successfully. Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29769487-2467-483f-af9c-3b5e7e9efc21 tempest-VolumeRetypeWithoutMigrationTest-896427545 None] Lock "cinder-9470c119-0d4e-466c-8471-0a0fddda2765-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:15 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Deleted volume successfully. Sep 23 00:23:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a78c4458-9ce9-4157-b5d2-65cd6f0a5b0c tempest-VolumesCloneTest-48682616 None] Lock "cinder-4c2cceb8-1f58-4d52-8f78-46dc1524862c-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=31,cinder:UPDATE=36,cinder:INSERT=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-c6b8ef34-f6d7-4699-9bde-0182092815dd req-dd59330c-f307-4d72-8f89-bfc3a0d5ee4b tempest-TestShelveInstance-1897680355 None] Terminate volume connection completed successfully. Sep 23 00:23:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-c6b8ef34-f6d7-4699-9bde-0182092815dd req-dd59330c-f307-4d72-8f89-bfc3a0d5ee4b tempest-TestShelveInstance-1897680355 None] Deleting attachment c862d2ff-531a-4440-a7bf-8ce67dd750cd. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-2bc7c9f7-a4a2-48dc-9bb6-ee5160d2c5f4 req-8b66792a-cf2c-4317-9ac8-fbedefd0e536 tempest-AttachVolumeNegativeTest-933588799 None] Terminate volume connection completed successfully. Sep 23 00:23:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-2bc7c9f7-a4a2-48dc-9bb6-ee5160d2c5f4 req-8b66792a-cf2c-4317-9ac8-fbedefd0e536 tempest-AttachVolumeNegativeTest-933588799 None] Deleting attachment 0ed7032d-0a0a-4468-ac3c-f59ab69cb751. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Flow 'volume_create_manager' (68d53118-a15c-46ad-a1bc-3c118a618a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bad6ff-abfd-4998-a139-28d969bcbd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bad6ff-abfd-4998-a139-28d969bcbd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-566038891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4f9b70-e170-41f1-8b0d-131b78376cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ed21e66c3e4c15b8f885a09b3d1346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:32Z,use_quota=True,user_id='65ddad113ab745b5a2dfcb26f503b50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66918fc1-849c-417e-9b48-6f4742d1a23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66918fc1-849c-417e-9b48-6f4742d1a23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23cbd90-6851-4909-9a47-974aab463099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23cbd90-6851-4909-9a47-974aab463099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4f9b70-e170-41f1-8b0d-131b78376cda', 'volume_name': 'volume-5b4f9b70-e170-41f1-8b0d-131b78376cda', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb46c95b-a4d0-42ec-9e32-96236d609a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb46c95b-a4d0-42ec-9e32-96236d609a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a879389b-1b66-4a51-b4ca-fd07681cfd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Volume 5b4f9b70-e170-41f1-8b0d-131b78376cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4f9b70-e170-41f1-8b0d-131b78376cda', 'volume_size': 1} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-566038891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4f9b70-e170-41f1-8b0d-131b78376cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ed21e66c3e4c15b8f885a09b3d1346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:32Z,use_quota=True,user_id='65ddad113ab745b5a2dfcb26f503b50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Creating volume 5b4f9b70-e170-41f1-8b0d-131b78376cda {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:32 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:32 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda 1073741824 Sep 23 00:23:32 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (f0258ffe-b6fe-44eb-8fa1-4ca5fa432fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f5e4f0-0b07-4c8e-9dbb-69037b52d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f5e4f0-0b07-4c8e-9dbb-69037b52d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2096122839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0ce658-952c-4942-ac15-d350c0a9521c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:33Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a388da-5a4b-4ced-bd5d-70c20a10157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a388da-5a4b-4ced-bd5d-70c20a10157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6583a6-276a-41c3-922c-923e6940dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6583a6-276a-41c3-922c-923e6940dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0ce658-952c-4942-ac15-d350c0a9521c', 'volume_name': 'volume-db0ce658-952c-4942-ac15-d350c0a9521c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e606a2-263e-47d1-a637-9becca4bb367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e606a2-263e-47d1-a637-9becca4bb367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c736a9-0f37-45e7-9dde-4fc99c15f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Volume db0ce658-952c-4942-ac15-d350c0a9521c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0ce658-952c-4942-ac15-d350c0a9521c', 'volume_size': 1} Sep 23 00:23:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-11c58d5a-8bb7-4a5b-a992-702257a0736d req-7f3dd79a-aaa6-4179-81f3-ae34b0b988dc tempest-TestShelveInstance-1897680355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:33 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda 1073741824" returned: 0 in 0.916s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:33 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda Sep 23 00:23:33 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2096122839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0ce658-952c-4942-ac15-d350c0a9521c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:33Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Creating volume db0ce658-952c-4942-ac15-d350c0a9521c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:33 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c 1073741824 Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a879389b-1b66-4a51-b4ca-fd07681cfd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4f9b70-e170-41f1-8b0d-131b78376cda', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:33 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e3014-eeb2-4e91-aebd-f6043ed589ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Volume volume-5b4f9b70-e170-41f1-8b0d-131b78376cda (5b4f9b70-e170-41f1-8b0d-131b78376cda): created successfully Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e3014-eeb2-4e91-aebd-f6043ed589ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Flow 'volume_create_manager' (68d53118-a15c-46ad-a1bc-3c118a618a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-176c0752-2aa1-41a8-a100-6be9f9d30c8f tempest-VolumesServicesTestJSON-175900959 None] Created volume successfully. Sep 23 00:23:34 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c 1073741824" returned: 0 in 0.759s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:34 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c Sep 23 00:23:34 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:34 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-11c58d5a-8bb7-4a5b-a992-702257a0736d req-7f3dd79a-aaa6-4179-81f3-ae34b0b988dc tempest-TestShelveInstance-1897680355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.691s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-11c58d5a-8bb7-4a5b-a992-702257a0736d req-7f3dd79a-aaa6-4179-81f3-ae34b0b988dc tempest-TestShelveInstance-1897680355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c736a9-0f37-45e7-9dde-4fc99c15f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0ce658-952c-4942-ac15-d350c0a9521c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d61266-b411-4278-8e90-10c43df7dce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Volume volume-db0ce658-952c-4942-ac15-d350c0a9521c (db0ce658-952c-4942-ac15-d350c0a9521c): created successfully Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d61266-b411-4278-8e90-10c43df7dce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (f0258ffe-b6fe-44eb-8fa1-4ca5fa432fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ef68574-2104-4965-9ea1-715b82826fdc tempest-VolumesListTestJSON-2039971069 None] Created volume successfully. Sep 23 00:23:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-11c58d5a-8bb7-4a5b-a992-702257a0736d req-7f3dd79a-aaa6-4179-81f3-ae34b0b988dc tempest-TestShelveInstance-1897680355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-3142e665-beae-4521-a29a-c0cadc14ad0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fb0e536-3947-4927-ab01-6beff8dd2faf', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:23:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-11c58d5a-8bb7-4a5b-a992-702257a0736d req-7f3dd79a-aaa6-4179-81f3-ae34b0b988dc tempest-TestShelveInstance-1897680355 None] attachment_update completed successfully. Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Acquiring lock "cinder-5b4f9b70-e170-41f1-8b0d-131b78376cda-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "cinder-5b4f9b70-e170-41f1-8b0d-131b78376cda-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Acquiring lock "cinder-quobyte-5b4f9b70-e170-41f1-8b0d-131b78376cda" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "cinder-quobyte-5b4f9b70-e170-41f1-8b0d-131b78376cda" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[66677920-a04f-4b12-bc4a-0d9ccd90be8f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:35 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda Sep 23 00:23:35 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda" returned: 0 in 0.729s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:36 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda Sep 23 00:23:36 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5b4f9b70-e170-41f1-8b0d-131b78376cda" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "cinder-quobyte-5b4f9b70-e170-41f1-8b0d-131b78376cda" released by "delete_volume" :: held 1.350s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (2494b737-83e1-4e0d-8bd1-d78062af9be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44402be7-013f-4f58-b32c-2f262392dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44402be7-013f-4f58-b32c-2f262392dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-897136358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de8e38-fa0c-4462-84db-917ce218c4a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:37Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e1a758-9dc1-45d6-a5b8-26cba4eb68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e1a758-9dc1-45d6-a5b8-26cba4eb68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a93343-81b3-49d4-88a8-28febce057fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a93343-81b3-49d4-88a8-28febce057fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63de8e38-fa0c-4462-84db-917ce218c4a0', 'volume_name': 'volume-63de8e38-fa0c-4462-84db-917ce218c4a0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daec4c14-7f35-48f3-9a9d-b71deb916caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daec4c14-7f35-48f3-9a9d-b71deb916caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d97f3f-f601-4dbf-a218-c1bff3f444c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Volume 63de8e38-fa0c-4462-84db-917ce218c4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63de8e38-fa0c-4462-84db-917ce218c4a0', 'volume_size': 1} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-897136358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de8e38-fa0c-4462-84db-917ce218c4a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:37Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Creating volume 63de8e38-fa0c-4462-84db-917ce218c4a0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Created reservations ['d0b62a52-f204-469c-90d9-948ac6a80860', '1fa7b6ce-1164-4602-b021-42a6d9dd6e24', 'e2e24b23-37e8-4a0d-8450-d716c7877fc2', '0f16de00-add5-4888-8256-cfee410eb168'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:37 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 1073741824 Sep 23 00:23:37 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:37 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Deleted volume successfully. Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-42221cd4-c20a-400b-96bc-da1f40eeabc0 tempest-VolumesServicesTestJSON-175900959 None] Lock "cinder-5b4f9b70-e170-41f1-8b0d-131b78376cda-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:37 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 1073741824" returned: 0 in 0.876s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 Sep 23 00:23:37 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:38 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d97f3f-f601-4dbf-a218-c1bff3f444c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63de8e38-fa0c-4462-84db-917ce218c4a0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e7e626-4e25-4af2-9835-9a19be734252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Volume volume-63de8e38-fa0c-4462-84db-917ce218c4a0 (63de8e38-fa0c-4462-84db-917ce218c4a0): created successfully Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e7e626-4e25-4af2-9835-9a19be734252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (2494b737-83e1-4e0d-8bd1-d78062af9be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-20f622dd-1147-4ad6-80af-0c765bb42293 tempest-VolumesListTestJSON-2039971069 None] Created volume successfully. Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (826fadc3-31dd-49f1-9b90-86b0e4b3ca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71147807-fb4d-4522-b6a2-408dec485b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71147807-fb4d-4522-b6a2-408dec485b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1788956993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e22dae-97f8-4263-88f5-50098d50d153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:40Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b70e20-dc36-415e-b714-6c51287ade21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b70e20-dc36-415e-b714-6c51287ade21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d6fed5-71b1-4601-b5ea-55a5c13ae877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d6fed5-71b1-4601-b5ea-55a5c13ae877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e22dae-97f8-4263-88f5-50098d50d153', 'volume_name': 'volume-b5e22dae-97f8-4263-88f5-50098d50d153', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb00d7e4-1709-47ff-87bc-1cfd9f7e69e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb00d7e4-1709-47ff-87bc-1cfd9f7e69e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3de712-840f-430a-8d33-694580349ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Volume b5e22dae-97f8-4263-88f5-50098d50d153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e22dae-97f8-4263-88f5-50098d50d153', 'volume_size': 1} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1788956993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e22dae-97f8-4263-88f5-50098d50d153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b95e9521324345cf8585086b5e302de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:40Z,use_quota=True,user_id='965f198366e1489e9196c36a090acd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Creating volume b5e22dae-97f8-4263-88f5-50098d50d153 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:40 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 1073741824 Sep 23 00:23:40 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:41 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 1073741824" returned: 0 in 1.140s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 Sep 23 00:23:42 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:42 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3de712-840f-430a-8d33-694580349ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e22dae-97f8-4263-88f5-50098d50d153', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c39462-1e49-43af-ad87-deb7b3203c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Volume volume-b5e22dae-97f8-4263-88f5-50098d50d153 (b5e22dae-97f8-4263-88f5-50098d50d153): created successfully Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c39462-1e49-43af-ad87-deb7b3203c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Flow 'volume_create_manager' (826fadc3-31dd-49f1-9b90-86b0e4b3ca25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cc3fdc99-2ed1-4479-bfcc-4830168ea4ca tempest-VolumesListTestJSON-2039971069 None] Created volume successfully. Sep 23 00:23:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-b5e22dae-97f8-4263-88f5-50098d50d153-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-b5e22dae-97f8-4263-88f5-50098d50d153-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-quobyte-b5e22dae-97f8-4263-88f5-50098d50d153" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-b5e22dae-97f8-4263-88f5-50098d50d153" acquired by "delete_volume" :: waited 0.110s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255bb55-3ecb-4570-ab38-c18c2880ca59]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:49 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 Sep 23 00:23:49 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:50 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:50 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:51 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153" returned: 0 in 1.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:51 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153 Sep 23 00:23:51 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:51 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 1.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b5e22dae-97f8-4263-88f5-50098d50d153" returned: 0 in 1.071s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-b5e22dae-97f8-4263-88f5-50098d50d153" released by "delete_volume" :: held 2.825s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=51,cinder:UPDATE=64,cinder:INSERT=14,cinder:DELETE=10 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Created reservations ['74d972b8-6128-4aab-a027-a15d64e7c30f', '5dcfd367-c6a9-478a-a76e-22c554216897', '9a7426c0-0205-4b0d-99be-ade9149fc3be', '1412a6a7-4fa2-4640-a24f-6a54e2a0e731'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:52 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:52 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:53 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Deleted volume successfully. Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9ac5ccd5-e6df-442c-a339-e13267d888e0 tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-b5e22dae-97f8-4263-88f5-50098d50d153-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-63de8e38-fa0c-4462-84db-917ce218c4a0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-63de8e38-fa0c-4462-84db-917ce218c4a0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-quobyte-63de8e38-fa0c-4462-84db-917ce218c4a0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-63de8e38-fa0c-4462-84db-917ce218c4a0" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3c4f8-2e55-4cad-8c4a-22df53ec125c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:53 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 Sep 23 00:23:53 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:54 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0" returned: 0 in 0.794s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:54 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0 Sep 23 00:23:54 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:54 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-63de8e38-fa0c-4462-84db-917ce218c4a0" returned: 0 in 0.515s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-63de8e38-fa0c-4462-84db-917ce218c4a0" released by "delete_volume" :: held 1.442s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Created reservations ['76a922cd-b62f-47f2-b22d-644727dc3c79', 'ec0956bf-fa2e-4fe8-835c-e6000529f0d5', '4b43466b-446e-4e28-b637-3307ba3278f4', 'b766a787-154f-4d21-8a12-aba114f33251'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:55 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:55 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:55 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.685s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Deleted volume successfully. Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-20548325-e35b-4c74-8c71-b3a3138789fe tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-63de8e38-fa0c-4462-84db-917ce218c4a0-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-db0ce658-952c-4942-ac15-d350c0a9521c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-db0ce658-952c-4942-ac15-d350c0a9521c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "cinder-quobyte-db0ce658-952c-4942-ac15-d350c0a9521c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-db0ce658-952c-4942-ac15-d350c0a9521c" acquired by "delete_volume" :: waited 0.070s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfd9e72-4c8d-4b7e-8a08-4024ee30fe39]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:56 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c Sep 23 00:23:56 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c" returned: 0 in 1.095s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c Sep 23 00:23:57 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (aa07814b-f564-4e9d-ab2a-423a22f2dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86a3f0a-6d25-4d4e-b16e-39315f8f0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86a3f0a-6d25-4d4e-b16e-39315f8f0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1762558641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1c850d-f5a7-436b-8c53-9b2dfd4569af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:58Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe06577e-e9d0-4ec8-98c5-9e8392c635ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe06577e-e9d0-4ec8-98c5-9e8392c635ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7ab9ad-e600-4f70-a550-2daa5119b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7ab9ad-e600-4f70-a550-2daa5119b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1c850d-f5a7-436b-8c53-9b2dfd4569af', 'volume_name': 'volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4130cab4-1971-4a32-9273-78be279f980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4130cab4-1971-4a32-9273-78be279f980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a1d79b-fc87-4f05-befd-f265bbbbd798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Volume dd1c850d-f5a7-436b-8c53-9b2dfd4569af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af', 'volume_size': 1} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1762558641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1c850d-f5a7-436b-8c53-9b2dfd4569af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:58Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Creating volume dd1c850d-f5a7-436b-8c53-9b2dfd4569af {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:23:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af 1073741824 Sep 23 00:23:58 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-db0ce658-952c-4942-ac15-d350c0a9521c" returned: 0 in 0.816s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-quobyte-db0ce658-952c-4942-ac15-d350c0a9521c" released by "delete_volume" :: held 2.015s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Created reservations ['e1ffd883-e131-4cfa-849a-9c5ae2c2469f', 'a1982819-a8d3-4f1e-a307-c1d066e70a65', '88fe652b-9002-478d-853a-ef99cdf4b4f8', '6fab97ca-9a61-4021-b388-341cb7040781'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af 1073741824" returned: 0 in 0.948s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:23:58 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:59 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af Sep 23 00:23:59 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:59 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.759s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Deleted volume successfully. Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a1d79b-fc87-4f05-befd-f265bbbbd798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8047fe05-4797-497c-b411-2484c6671192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Volume volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af (dd1c850d-f5a7-436b-8c53-9b2dfd4569af): created successfully Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8047fe05-4797-497c-b411-2484c6671192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (aa07814b-f564-4e9d-ab2a-423a22f2dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e8d119c-e74f-4220-8a29-3cf409850b8f tempest-VolumesListTestJSON-2039971069 None] Lock "cinder-db0ce658-952c-4942-ac15-d350c0a9521c-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9fb0e83c-dbf2-41a9-ab0f-b35fd91ad4ef tempest-VolumesListAdminTestJSON-1349826750 None] Created volume successfully. Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (cd984c31-1b8a-4eb2-bff8-b68783aa113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecde027f-232e-4344-abc6-a5613055bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecde027f-232e-4344-abc6-a5613055bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-319126881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781663ab-ce91-411a-b311-6b7df30cb4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:02Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0277e4a4-832a-4e66-b92f-1547b83f0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0277e4a4-832a-4e66-b92f-1547b83f0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb47bec-4d65-44d0-96d5-b65388d627a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb47bec-4d65-44d0-96d5-b65388d627a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781663ab-ce91-411a-b311-6b7df30cb4c5', 'volume_name': 'volume-781663ab-ce91-411a-b311-6b7df30cb4c5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b430c-1bec-400a-b783-6822deb980a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b430c-1bec-400a-b783-6822deb980a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05b18fb-f313-4b3c-b7a2-01e87fcf32f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Volume 781663ab-ce91-411a-b311-6b7df30cb4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781663ab-ce91-411a-b311-6b7df30cb4c5', 'volume_size': 1} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-319126881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781663ab-ce91-411a-b311-6b7df30cb4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:02Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Creating volume 781663ab-ce91-411a-b311-6b7df30cb4c5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:02 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:02 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 1073741824 Sep 23 00:24:02 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:02 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 1073741824" returned: 0 in 0.755s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:03 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 Sep 23 00:24:03 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:03 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05b18fb-f313-4b3c-b7a2-01e87fcf32f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781663ab-ce91-411a-b311-6b7df30cb4c5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da64d3c-4e05-4b59-b09d-183f0385d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Volume volume-781663ab-ce91-411a-b311-6b7df30cb4c5 (781663ab-ce91-411a-b311-6b7df30cb4c5): created successfully Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da64d3c-4e05-4b59-b09d-183f0385d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (cd984c31-1b8a-4eb2-bff8-b68783aa113a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-baae9340-b35d-4538-a868-0344e88e08d7 tempest-VolumesListAdminTestJSON-1349826750 None] Created volume successfully. Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (438bc75b-8f2b-4f3d-9e23-0ec60ee2373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3070dd81-e2a3-4724-952d-2bba4b00cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3070dd81-e2a3-4724-952d-2bba4b00cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1002957828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794fc927-f20c-4dc9-a946-e0970e30a4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:05Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922ee3c0-d073-4edc-8ac5-b4d3f893f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922ee3c0-d073-4edc-8ac5-b4d3f893f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bac0f2b-c254-4613-b82d-6d053f4c8da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bac0f2b-c254-4613-b82d-6d053f4c8da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794fc927-f20c-4dc9-a946-e0970e30a4f4', 'volume_name': 'volume-794fc927-f20c-4dc9-a946-e0970e30a4f4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94018f70-e89a-4838-bc2f-9f2200a90a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94018f70-e89a-4838-bc2f-9f2200a90a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cef0e8-c566-479d-8743-75110c0bcb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Volume 794fc927-f20c-4dc9-a946-e0970e30a4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794fc927-f20c-4dc9-a946-e0970e30a4f4', 'volume_size': 1} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1002957828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794fc927-f20c-4dc9-a946-e0970e30a4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2085c919c5b04449b5c25e83ac5906cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:05Z,use_quota=True,user_id='0f087b7310124345ad9b4dc6df60ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Creating volume 794fc927-f20c-4dc9-a946-e0970e30a4f4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:05 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 1073741824 Sep 23 00:24:05 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:06 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 1073741824" returned: 0 in 0.716s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:06 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 Sep 23 00:24:06 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:06 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cef0e8-c566-479d-8743-75110c0bcb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794fc927-f20c-4dc9-a946-e0970e30a4f4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bb343f-017f-428f-bbfb-5ce7b0cb9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Volume volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 (794fc927-f20c-4dc9-a946-e0970e30a4f4): created successfully Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bb343f-017f-428f-bbfb-5ce7b0cb9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Flow 'volume_create_manager' (438bc75b-8f2b-4f3d-9e23-0ec60ee2373b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-53334a57-c2e3-4dea-9c4f-cd68e1ac7857 tempest-VolumesListAdminTestJSON-1349826750 None] Created volume successfully. Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Flow 'volume_create_manager' (0e595d0d-31de-4517-8585-0996a5fce630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679666e-4e60-4309-860b-e43d33bbf597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3679666e-4e60-4309-860b-e43d33bbf597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b78bb8-9a82-44fb-8aff-c4bc27b3a79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ed7ea7b5d64f4ea80d60cb4f842679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:09Z,use_quota=True,user_id='070cd295995e42b7ad122d6c0725ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129bcf9a-94a1-4d69-9837-388bfaa5a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129bcf9a-94a1-4d69-9837-388bfaa5a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfee56f-0588-4c05-977d-d30917188bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfee56f-0588-4c05-977d-d30917188bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b78bb8-9a82-44fb-8aff-c4bc27b3a79a', 'volume_name': 'volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e0cd9-1ec5-4038-81f1-c3c34f1c8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e0cd9-1ec5-4038-81f1-c3c34f1c8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a5c9d9-9676-416c-80e4-945ed36dfc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Volume 67b78bb8-9a82-44fb-8aff-c4bc27b3a79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a', 'volume_size': 1} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b78bb8-9a82-44fb-8aff-c4bc27b3a79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ed7ea7b5d64f4ea80d60cb4f842679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:09Z,use_quota=True,user_id='070cd295995e42b7ad122d6c0725ebfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Creating volume 67b78bb8-9a82-44fb-8aff-c4bc27b3a79a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:08 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a 1073741824 Sep 23 00:24:08 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:09 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a 1073741824" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:09 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a Sep 23 00:24:09 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:09 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a5c9d9-9676-416c-80e4-945ed36dfc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7697c-4343-4215-8335-60bb3c5ee73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Volume volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a (67b78bb8-9a82-44fb-8aff-c4bc27b3a79a): created successfully Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7697c-4343-4215-8335-60bb3c5ee73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Flow 'volume_create_manager' (0e595d0d-31de-4517-8585-0996a5fce630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c76501a4-a272-4110-a59d-d7bf37c78364 tempest-VolumesListAdminTestJSON-1704253046 None] Created volume successfully. Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Acquiring lock "cinder-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "cinder-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Acquiring lock "cinder-quobyte-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "cinder-quobyte-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b068f-65fb-4b20-981e-6503c659217c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-794fc927-f20c-4dc9-a946-e0970e30a4f4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-794fc927-f20c-4dc9-a946-e0970e30a4f4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-quobyte-794fc927-f20c-4dc9-a946-e0970e30a4f4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-794fc927-f20c-4dc9-a946-e0970e30a4f4" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:11 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a Sep 23 00:24:11 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e658b3-7324-4207-a8ff-ed3293a0381c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:12 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 Sep 23 00:24:12 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:12 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" returned: 0 in 1.225s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:12 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a Sep 23 00:24:12 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:12 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4" returned: 0 in 1.150s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:12 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4 Sep 23 00:24:12 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:13 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "cinder-quobyte-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a" released by "delete_volume" :: held 1.949s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Created reservations ['2e7ef611-2c67-44ea-9291-c234dad51ffe', '2cc62aed-c89d-4430-a631-dbbb54867cff', '22e078c6-2647-4ee2-a3a0-8afb0fe31b5e', 'e0a78e7f-cad3-45ec-8c0e-4f86f8328357'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:13 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-794fc927-f20c-4dc9-a946-e0970e30a4f4" returned: 0 in 0.849s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:13 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:13 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-794fc927-f20c-4dc9-a946-e0970e30a4f4" released by "delete_volume" :: held 2.116s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Created reservations ['1844a0b0-c5f5-4954-81b8-852649792a99', '1bacf213-5b06-4564-bf76-9f35d688c006', 'd76a7caa-7092-40fe-8ea5-2389bea06e71', '052b7b47-f5da-48d6-a3ee-b4126402359e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:14 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:14 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:14 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Deleted volume successfully. Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e987eaa-41c0-4fa2-bfd8-d4067e12c2c3 tempest-VolumesListAdminTestJSON-1704253046 None] Lock "cinder-67b78bb8-9a82-44fb-8aff-c4bc27b3a79a-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:14 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Deleted volume successfully. Sep 23 00:24:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07ba7756-6ba4-427a-904b-f2f4853be6e8 tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-794fc927-f20c-4dc9-a946-e0970e30a4f4-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-781663ab-ce91-411a-b311-6b7df30cb4c5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-781663ab-ce91-411a-b311-6b7df30cb4c5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-quobyte-781663ab-ce91-411a-b311-6b7df30cb4c5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-781663ab-ce91-411a-b311-6b7df30cb4c5" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb12f10-b4ae-42e3-9621-ecbcdcfa4f33]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:15 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 Sep 23 00:24:15 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:16 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5 Sep 23 00:24:16 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:16 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-781663ab-ce91-411a-b311-6b7df30cb4c5" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-781663ab-ce91-411a-b311-6b7df30cb4c5" released by "delete_volume" :: held 1.108s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Created reservations ['a08ecbd4-fc12-4d92-b864-0d35f327ca6a', '3074ea08-d122-4089-a525-c6ddcf99a981', '5b7e62ff-4e1b-403c-8a06-2a465a823709', '35331ae9-eb57-4e75-a44d-ca3350dfac72'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:16 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:17 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Deleted volume successfully. Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4c3a9199-18d3-4387-b365-0983ad4b4d3d tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-781663ab-ce91-411a-b311-6b7df30cb4c5-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-dd1c850d-f5a7-436b-8c53-9b2dfd4569af-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-dd1c850d-f5a7-436b-8c53-9b2dfd4569af-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "cinder-quobyte-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114e3df-38cc-47b4-a9af-159f6a435a82]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af Sep 23 00:24:18 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" returned: 0 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af Sep 23 00:24:18 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (06b73e4f-a1c5-431c-b60a-52f0a65381ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aa9cee-b49f-4fa2-ab3e-d7ffca8d6205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aa9cee-b49f-4fa2-ab3e-d7ffca8d6205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1231683761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a5e593-d05a-46ad-8334-b371ee08bb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:19Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674f179-e0c4-4a53-8157-ce5d2bdf5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674f179-e0c4-4a53-8157-ce5d2bdf5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d9ceb4-c9a5-42c0-9990-d806d954fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d9ceb4-c9a5-42c0-9990-d806d954fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a5e593-d05a-46ad-8334-b371ee08bb96', 'volume_name': 'volume-f4a5e593-d05a-46ad-8334-b371ee08bb96', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064d4c2b-a235-4aa5-99cd-5e6e5f96fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064d4c2b-a235-4aa5-99cd-5e6e5f96fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e741cb-dba1-4f8e-8f20-ca454e8cca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Volume f4a5e593-d05a-46ad-8334-b371ee08bb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a5e593-d05a-46ad-8334-b371ee08bb96', 'volume_size': 1} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1231683761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a5e593-d05a-46ad-8334-b371ee08bb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:19Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Creating volume f4a5e593-d05a-46ad-8334-b371ee08bb96 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:18 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 1073741824 Sep 23 00:24:18 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-quobyte-dd1c850d-f5a7-436b-8c53-9b2dfd4569af" released by "delete_volume" :: held 1.085s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Created reservations ['472f6ca2-41d4-45f1-a947-a43b7c53fad1', '584de790-d6da-4d0a-966a-18b368c19311', 'acb54577-98cb-4c34-bcc8-5908a21a5f94', '321450b4-3831-4d82-8731-89d01337c544'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:19 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 1073741824" returned: 0 in 0.624s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Deleted volume successfully. Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0fe8267-4e2b-4ebd-b03c-046079258b5c tempest-VolumesListAdminTestJSON-1349826750 None] Lock "cinder-dd1c850d-f5a7-436b-8c53-9b2dfd4569af-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:19 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 Sep 23 00:24:19 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96" returned: 0 in 0.350s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e741cb-dba1-4f8e-8f20-ca454e8cca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a5e593-d05a-46ad-8334-b371ee08bb96', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75969a96-635b-439b-91e7-0394fc45db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Volume volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 (f4a5e593-d05a-46ad-8334-b371ee08bb96): created successfully Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75969a96-635b-439b-91e7-0394fc45db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (06b73e4f-a1c5-431c-b60a-52f0a65381ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-12367330-f44e-480c-a354-7c3bdac23696 tempest-AttachVolumeNegativeTest-933588799 None] Created volume successfully. Sep 23 00:24:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f72a8897-d2fe-4f55-b7fd-c673507d4bf3 req-49b194cc-cb7c-40bd-9786-a008b59918ea tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f72a8897-d2fe-4f55-b7fd-c673507d4bf3 req-49b194cc-cb7c-40bd-9786-a008b59918ea tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-f72a8897-d2fe-4f55-b7fd-c673507d4bf3 req-49b194cc-cb7c-40bd-9786-a008b59918ea tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-f72a8897-d2fe-4f55-b7fd-c673507d4bf3 req-49b194cc-cb7c-40bd-9786-a008b59918ea tempest-AttachVolumeNegativeTest-933588799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-f4a5e593-d05a-46ad-8334-b371ee08bb96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5627f0a2-20e1-415c-a0ef-f8d85fde50c0', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-f72a8897-d2fe-4f55-b7fd-c673507d4bf3 req-49b194cc-cb7c-40bd-9786-a008b59918ea tempest-AttachVolumeNegativeTest-933588799 None] attachment_update completed successfully. Sep 23 00:24:25 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=79,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-d6b8d01a-8443-4b9e-bddf-19a0f1593c7f req-b18ca0e0-5a48-4dd7-9255-4228122e70a2 tempest-AttachVolumeNegativeTest-933588799 None] Terminate volume connection completed successfully. Sep 23 00:24:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-d6b8d01a-8443-4b9e-bddf-19a0f1593c7f req-b18ca0e0-5a48-4dd7-9255-4228122e70a2 tempest-AttachVolumeNegativeTest-933588799 None] Deleting attachment 5627f0a2-20e1-415c-a0ef-f8d85fde50c0. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-094327a5-2cd6-47be-9b40-9109791c1d8e tempest-TestShelveInstance-1897680355 None] Terminate volume connection completed successfully. Sep 23 00:24:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-094327a5-2cd6-47be-9b40-9109791c1d8e tempest-TestShelveInstance-1897680355 None] Deleting attachment 9fb0e536-3947-4927-ab01-6beff8dd2faf. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Acquiring lock "cinder-3142e665-beae-4521-a29a-c0cadc14ad0a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "cinder-3142e665-beae-4521-a29a-c0cadc14ad0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Acquiring lock "cinder-quobyte-3142e665-beae-4521-a29a-c0cadc14ad0a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "cinder-quobyte-3142e665-beae-4521-a29a-c0cadc14ad0a" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[368993e4-de5b-405e-9ef0-deee320e5549]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a Sep 23 00:24:29 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a" returned: 0 in 0.736s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:30 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a Sep 23 00:24:30 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3142e665-beae-4521-a29a-c0cadc14ad0a" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "cinder-quobyte-3142e665-beae-4521-a29a-c0cadc14ad0a" released by "delete_volume" :: held 1.321s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG cinder.quota [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Created reservations ['0f219c73-493b-4932-9d1a-bceb057ca4c8', '5584b123-64bb-400f-b059-633632fd7735', 'c066c1a1-f411-462d-99a7-5be9e7f98c64', 'beab5097-35e3-497b-8c87-4c55494282eb'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:31 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[87132]: DEBUG cinder.manager [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Deleted volume successfully. Sep 23 00:24:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [req-60959006-d9bc-4548-bf3f-fd41ea92fc05 req-ca0e026f-3a31-4ee2-8b25-5eb77334d51d tempest-TestShelveInstance-1897680355 None] Lock "cinder-3142e665-beae-4521-a29a-c0cadc14ad0a-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Flow 'volume_create_manager' (db122302-28ca-4c56-a386-70b8b73db054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74118789-f9bf-46c9-b2e2-0bf1a68ed6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74118789-f9bf-46c9-b2e2-0bf1a68ed6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1556860763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d30586-c74a-4aa6-a4cc-167aeb49abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e820a0d7fdd645cf99d0a7b4bcdf6ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:32Z,use_quota=True,user_id='64b86fbd546c446f8e3ed5926c104ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab911a5-52e5-477a-8879-c6e98785f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab911a5-52e5-477a-8879-c6e98785f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f32d7-3f0e-4ac3-b9e9-6d65d605540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14f32d7-3f0e-4ac3-b9e9-6d65d605540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d30586-c74a-4aa6-a4cc-167aeb49abac', 'volume_name': 'volume-48d30586-c74a-4aa6-a4cc-167aeb49abac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857bfda8-0202-4bb4-8f17-4101a424d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857bfda8-0202-4bb4-8f17-4101a424d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001fb4ff-f458-43b6-91a9-2f447acf2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Volume 48d30586-c74a-4aa6-a4cc-167aeb49abac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d30586-c74a-4aa6-a4cc-167aeb49abac', 'volume_size': 1} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1556860763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d30586-c74a-4aa6-a4cc-167aeb49abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e820a0d7fdd645cf99d0a7b4bcdf6ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:32Z,use_quota=True,user_id='64b86fbd546c446f8e3ed5926c104ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Creating volume 48d30586-c74a-4aa6-a4cc-167aeb49abac {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:32 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:32 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac 1073741824 Sep 23 00:24:32 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac 1073741824" returned: 0 in 0.700s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac Sep 23 00:24:33 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001fb4ff-f458-43b6-91a9-2f447acf2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d30586-c74a-4aa6-a4cc-167aeb49abac', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46a4aa4-7d43-4784-8a1c-4a37fbe59dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Volume volume-48d30586-c74a-4aa6-a4cc-167aeb49abac (48d30586-c74a-4aa6-a4cc-167aeb49abac): created successfully Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46a4aa4-7d43-4784-8a1c-4a37fbe59dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Flow 'volume_create_manager' (db122302-28ca-4c56-a386-70b8b73db054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ddf5a1a1-f0c9-46f1-b1c9-7eef73682104 tempest-AbsoluteLimitsTests-597618781 None] Created volume successfully. Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Acquiring lock "cinder-48d30586-c74a-4aa6-a4cc-167aeb49abac-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "cinder-48d30586-c74a-4aa6-a4cc-167aeb49abac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Acquiring lock "cinder-quobyte-48d30586-c74a-4aa6-a4cc-167aeb49abac" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "cinder-quobyte-48d30586-c74a-4aa6-a4cc-167aeb49abac" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7921fcc-1bf3-48b6-86eb-ec8f6ddebed9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac Sep 23 00:24:35 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:35 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac Sep 23 00:24:35 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-48d30586-c74a-4aa6-a4cc-167aeb49abac" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "cinder-quobyte-48d30586-c74a-4aa6-a4cc-167aeb49abac" released by "delete_volume" :: held 1.202s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Created reservations ['edd94535-7100-4e27-a913-1e17eefe5f16', '73c82b4d-777d-4960-bf16-8244186b932e', '787f3d38-680b-47ea-b115-9beba3a96c0d', '3880cfe6-de11-4a3d-b6b0-58b6b3c3afe2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:36 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:36 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Deleted volume successfully. Sep 23 00:24:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1a43b9-696d-4ae1-ab88-44fe92ae88d8 tempest-AbsoluteLimitsTests-597618781 None] Lock "cinder-48d30586-c74a-4aa6-a4cc-167aeb49abac-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:46 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=12,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:46 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:INSERT=18,cinder:UPDATE=91,cinder:SELECT=64,cinder:DELETE=8 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:49 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:24:49 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (2303dd6a-fff7-4ea7-b9af-8a8e8533f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e64449f-112b-410a-b28e-1a3a0f0abece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e64449f-112b-410a-b28e-1a3a0f0abece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1031533999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2389ad2-cd62-4cd8-bb32-29e3c783bbb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:51Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796240eb-3916-4a30-987e-8164b60eeea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796240eb-3916-4a30-987e-8164b60eeea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74f6cc7-f021-4640-b2e0-86750f0fc21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74f6cc7-f021-4640-b2e0-86750f0fc21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2389ad2-cd62-4cd8-bb32-29e3c783bbb4', 'volume_name': 'volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c22a62-dd06-413d-9cfa-6710f33db54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c22a62-dd06-413d-9cfa-6710f33db54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a963f1-b38b-48e9-b46e-58c0f6875dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Volume b2389ad2-cd62-4cd8-bb32-29e3c783bbb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4', 'volume_size': 1} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1031533999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2389ad2-cd62-4cd8-bb32-29e3c783bbb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:51Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Creating volume b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 1073741824 Sep 23 00:24:51 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 1073741824" returned: 0 in 1.016s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 Sep 23 00:24:52 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" returned: 0 in 0.589s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a963f1-b38b-48e9-b46e-58c0f6875dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55caadea-8c08-4d06-a92a-a6042355b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Volume volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 (b2389ad2-cd62-4cd8-bb32-29e3c783bbb4): created successfully Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55caadea-8c08-4d06-a92a-a6042355b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (2303dd6a-fff7-4ea7-b9af-8a8e8533f53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-107233e5-bb6f-4887-85e8-04ab9e3ce20b tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:24:55 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (70b9d9d7-a433-4218-8ec8-72c59d25c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:55 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba688f39-c3ed-4b16-b616-f06717026dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba688f39-c3ed-4b16-b616-f06717026dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2146558368',display_name='tempest-VolumesGetTest-Volume-1138291776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99f2069-6f01-40d7-b5e0-16e90d729de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:56Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696907f-b763-40b2-85e8-6c933f9d073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696907f-b763-40b2-85e8-6c933f9d073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce3dedc-0b47-43c9-b33f-479d229031ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce3dedc-0b47-43c9-b33f-479d229031ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99f2069-6f01-40d7-b5e0-16e90d729de0', 'volume_name': 'volume-c99f2069-6f01-40d7-b5e0-16e90d729de0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c7f2a8-f669-40c0-b642-6755fb5042df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c7f2a8-f669-40c0-b642-6755fb5042df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a49e5d-e8f5-4072-beea-195c28087d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Volume c99f2069-6f01-40d7-b5e0-16e90d729de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99f2069-6f01-40d7-b5e0-16e90d729de0', 'volume_size': 1} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2146558368',display_name='tempest-VolumesGetTest-Volume-1138291776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99f2069-6f01-40d7-b5e0-16e90d729de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:56Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Creating volume c99f2069-6f01-40d7-b5e0-16e90d729de0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 1073741824 Sep 23 00:24:56 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 1073741824" returned: 0 in 0.772s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:57 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 Sep 23 00:24:57 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:57 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a49e5d-e8f5-4072-beea-195c28087d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99f2069-6f01-40d7-b5e0-16e90d729de0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d82bfb-8f77-40d3-856d-5400b97eb4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Volume volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 (c99f2069-6f01-40d7-b5e0-16e90d729de0): created successfully Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d82bfb-8f77-40d3-856d-5400b97eb4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (70b9d9d7-a433-4218-8ec8-72c59d25c99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4bc504d3-b9ef-4f16-a44b-ef54919d3637 tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-c99f2069-6f01-40d7-b5e0-16e90d729de0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "cinder-c99f2069-6f01-40d7-b5e0-16e90d729de0-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-c99f2069-6f01-40d7-b5e0-16e90d729de0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-c99f2069-6f01-40d7-b5e0-16e90d729de0" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bd4e0-c3d0-4d4b-a6ed-30fd931ea627]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:58 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 Sep 23 00:24:58 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:59 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0" returned: 0 in 0.737s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:59 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0 Sep 23 00:24:59 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:59 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c99f2069-6f01-40d7-b5e0-16e90d729de0" returned: 0 in 0.648s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-c99f2069-6f01-40d7-b5e0-16e90d729de0" released by "delete_volume" :: held 1.511s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Created reservations ['f0a7d5bd-a630-4759-ab2c-cc3f5c50ae72', '5b09beec-29cc-44a6-a552-c4675b6fb364', '716103a3-080d-4b23-b1c6-5d386a0d66f7', 'abd58a90-14f6-4cf6-bd63-3d025a50efdd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:00 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.518s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fc41673a-92aa-48bf-a33b-1323a2f67766 tempest-VolumesGetTest-848985921 None] Lock "cinder-c99f2069-6f01-40d7-b5e0-16e90d729de0-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "cinder-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[46393fa9-bb26-47b2-8ee6-ab2c1ea1ecd2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:01 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 Sep 23 00:25:01 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:02 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" returned: 0 in 1.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:02 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4 Sep 23 00:25:02 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:03 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" returned: 0 in 1.055s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4" released by "delete_volume" :: held 2.809s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Created reservations ['e32f5099-0139-4985-b7d9-0e7ede140958', 'b238a09a-3db6-4e18-bd78-485d27d29fa7', 'f8f153d4-514a-4184-b8ba-60b696a5a2d8', '92ef82bd-bd73-492b-b460-0ec5f8024825'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:04 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:04 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:05 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.924s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-47b64640-709d-4666-bf6b-a9240e234dce tempest-VolumesGetTest-848985921 None] Lock "cinder-b2389ad2-cd62-4cd8-bb32-29e3c783bbb4-delete_volume" released by "delete_volume" :: held 4.607s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Flow 'volume_create_manager' (4213aafb-b8b1-43c4-8cf6-ffdd3c80b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db8616c-14f8-4d87-988c-a885972136f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db8616c-14f8-4d87-988c-a885972136f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362820399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358faa46-f78a-41a2-9379-aad53e660154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741844807c084d0b82f97c1f9d89541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:05Z,use_quota=True,user_id='a4ed91781ee649508b42b8917083c213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbefe003-3c5d-477c-88ad-cf78b1d0a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbefe003-3c5d-477c-88ad-cf78b1d0a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20558131-c166-4e31-a9e4-8ea407e87ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20558131-c166-4e31-a9e4-8ea407e87ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358faa46-f78a-41a2-9379-aad53e660154', 'volume_name': 'volume-358faa46-f78a-41a2-9379-aad53e660154', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a54ae-6e1e-4837-8811-3e8468af93e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a54ae-6e1e-4837-8811-3e8468af93e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6972bfe-01e8-4f5c-bbf4-04d3280ae911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Volume 358faa46-f78a-41a2-9379-aad53e660154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358faa46-f78a-41a2-9379-aad53e660154', 'volume_size': 1} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362820399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358faa46-f78a-41a2-9379-aad53e660154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741844807c084d0b82f97c1f9d89541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:05Z,use_quota=True,user_id='a4ed91781ee649508b42b8917083c213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Creating volume 358faa46-f78a-41a2-9379-aad53e660154 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:06 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 1073741824 Sep 23 00:25:06 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (36bd0633-210f-4867-8918-d003a10b3382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7215cd96-7b7d-454c-810a-9f52ac22654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7215cd96-7b7d-454c-810a-9f52ac22654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519691097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dc5e25-0aff-441c-a986-fbcc9be422dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:07Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f306b-de1e-458c-a239-aa2310f2ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71f306b-de1e-458c-a239-aa2310f2ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fed282-d6c3-41ba-a12d-e29a32bcdde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96fed282-d6c3-41ba-a12d-e29a32bcdde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88dc5e25-0aff-441c-a986-fbcc9be422dc', 'volume_name': 'volume-88dc5e25-0aff-441c-a986-fbcc9be422dc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2143a3b0-9cce-4833-8bfb-cc4a11474723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2143a3b0-9cce-4833-8bfb-cc4a11474723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6302f6b8-2007-4419-9057-022abe0615e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Volume 88dc5e25-0aff-441c-a986-fbcc9be422dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88dc5e25-0aff-441c-a986-fbcc9be422dc', 'volume_size': 1} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:07 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 1073741824" returned: 0 in 1.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:07 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 Sep 23 00:25:07 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1519691097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dc5e25-0aff-441c-a986-fbcc9be422dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:07Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Creating volume 88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6972bfe-01e8-4f5c-bbf4-04d3280ae911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358faa46-f78a-41a2-9379-aad53e660154', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9367f-961e-463c-92da-a8b64294fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:08 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc 1073741824 Sep 23 00:25:08 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Volume volume-358faa46-f78a-41a2-9379-aad53e660154 (358faa46-f78a-41a2-9379-aad53e660154): created successfully Sep 23 00:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f9367f-961e-463c-92da-a8b64294fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Flow 'volume_create_manager' (4213aafb-b8b1-43c4-8cf6-ffdd3c80b127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cb96e7eb-b87f-4fe0-9b64-b876687fe484 tempest-ProjectReaderTests-1358139249 None] Created volume successfully. Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "cinder-358faa46-f78a-41a2-9379-aad53e660154-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "cinder-358faa46-f78a-41a2-9379-aad53e660154-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:09 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc 1073741824" returned: 0 in 1.185s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "cinder-quobyte-358faa46-f78a-41a2-9379-aad53e660154" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "cinder-quobyte-358faa46-f78a-41a2-9379-aad53e660154" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a1ca96-7dca-4050-989b-9ac8d4511986]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:09 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 Sep 23 00:25:09 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6302f6b8-2007-4419-9057-022abe0615e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dc5e25-0aff-441c-a986-fbcc9be422dc', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25320b8e-1308-441e-85b2-91f9cf1fa92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Volume volume-88dc5e25-0aff-441c-a986-fbcc9be422dc (88dc5e25-0aff-441c-a986-fbcc9be422dc): created successfully Sep 23 00:25:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25320b8e-1308-441e-85b2-91f9cf1fa92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (36bd0633-210f-4867-8918-d003a10b3382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ac735739-1554-47bf-9ddc-dc1adaaf05f4 tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:25:10 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154" returned: 0 in 0.882s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154 Sep 23 00:25:10 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Flow 'volume_create_manager' (75d2ad10-4970-45a7-a752-cc157710cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1e22a-8ae3-44b7-ae07-341dec4e9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb1e22a-8ae3-44b7-ae07-341dec4e9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1889965171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d684d109-21bf-49b4-8c0f-5cc36feab3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2c17c06c614c41a11c8c9f350165ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:11Z,use_quota=True,user_id='8058664b628747a9ab7d1c520f143773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d538f89-193a-468b-a0ad-6d9907e5a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d538f89-193a-468b-a0ad-6d9907e5a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec553db-4199-4e64-9c0d-32470e3a84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec553db-4199-4e64-9c0d-32470e3a84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd684d109-21bf-49b4-8c0f-5cc36feab3da', 'volume_name': 'volume-d684d109-21bf-49b4-8c0f-5cc36feab3da', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4fb535-caaa-4208-84db-219d52690cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4fb535-caaa-4208-84db-219d52690cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e5917-43d0-44f1-9bb8-9ec6031ad0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Volume d684d109-21bf-49b4-8c0f-5cc36feab3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d684d109-21bf-49b4-8c0f-5cc36feab3da', 'volume_size': 1} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1889965171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d684d109-21bf-49b4-8c0f-5cc36feab3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2c17c06c614c41a11c8c9f350165ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:11Z,use_quota=True,user_id='8058664b628747a9ab7d1c520f143773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Creating volume d684d109-21bf-49b4-8c0f-5cc36feab3da {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-358faa46-f78a-41a2-9379-aad53e660154" returned: 0 in 0.709s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da 1073741824 Sep 23 00:25:10 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "cinder-quobyte-358faa46-f78a-41a2-9379-aad53e660154" released by "delete_volume" :: held 1.713s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Created reservations ['c44265eb-50ac-4d72-b17d-20bb2ab94aa4', '7d3ad52d-2ee2-4219-9801-dc4ab0d607a0', '6f2758a6-aa54-4757-88f1-7f93e517ae3e', 'b85c9622-de1f-4332-9b5f-3a76760a4ca3'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:11 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:12 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.765s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Deleted volume successfully. Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (270e39a7-3aeb-476e-ab2a-dd1bfa5de834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a73d8ba-e0f9-4e02-9d10-a8f1d2a5abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a73d8ba-e0f9-4e02-9d10-a8f1d2a5abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-934768658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=88dc5e25-0aff-441c-a986-fbcc9be422dc,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:12Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021c0c43-02d1-4de7-a5de-b459144a4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021c0c43-02d1-4de7-a5de-b459144a4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df766ae-e4b0-495a-91c8-68e25978b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-70f61969-9159-47d3-80fa-3515dc61e093 tempest-ProjectReaderTests-1358139249 None] Lock "cinder-358faa46-f78a-41a2-9379-aad53e660154-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df766ae-e4b0-495a-91c8-68e25978b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc', 'volume_name': 'volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc', 'volume_size': 1, 'source_volid': '88dc5e25-0aff-441c-a986-fbcc9be422dc', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e182f825-4c8b-490d-b68a-ceea95649b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e182f825-4c8b-490d-b68a-ceea95649b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107dd122-a076-4666-b794-62e2376c6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Volume fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc', 'volume_size': 1, 'source_volid': '88dc5e25-0aff-441c-a986-fbcc9be422dc', 'source_volstatus': 'available'} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da 1073741824" returned: 0 in 1.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da Sep 23 00:25:12 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Flow 'volume_create_manager' (820fb080-7a4c-424c-a1ef-84920ecf006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77381ea4-638e-4c4e-a571-5d8a5178a2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77381ea4-638e-4c4e-a571-5d8a5178a2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175277291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f5687-481f-4c16-b8ed-71c99458b568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741844807c084d0b82f97c1f9d89541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:13Z,use_quota=True,user_id='a4ed91781ee649508b42b8917083c213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6554df11-2c1a-4843-84f0-bed9191763c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6554df11-2c1a-4843-84f0-bed9191763c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5d09e2-3b76-43aa-bcca-4d5cf0cd73c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5d09e2-3b76-43aa-bcca-4d5cf0cd73c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8f5687-481f-4c16-b8ed-71c99458b568', 'volume_name': 'volume-8f8f5687-481f-4c16-b8ed-71c99458b568', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6855a98e-1874-4dac-96ea-fbbf3497c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6855a98e-1874-4dac-96ea-fbbf3497c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a5cb9a-c192-4e16-a052-24b42b8f68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Volume 8f8f5687-481f-4c16-b8ed-71c99458b568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8f5687-481f-4c16-b8ed-71c99458b568', 'volume_size': 1} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.621s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Cloning volume 88dc5e25-0aff-441c-a986-fbcc9be422dc to volume fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc Sep 23 00:25:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e5917-43d0-44f1-9bb8-9ec6031ad0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d684d109-21bf-49b4-8c0f-5cc36feab3da', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3517115a-326e-4b4c-bab7-5232630ce92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Volume volume-d684d109-21bf-49b4-8c0f-5cc36feab3da (d684d109-21bf-49b4-8c0f-5cc36feab3da): created successfully Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3517115a-326e-4b4c-bab7-5232630ce92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Flow 'volume_create_manager' (75d2ad10-4970-45a7-a752-cc157710cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Creating offline snapshot 5b666bb1-64d5-420b-aa7d-c58872172f9e of volume 88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-eb685f28-d5d5-4593-b930-e4ecf626e56f tempest-TestMinimumBasicScenario-1944249495 None] Created volume successfully. Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[913df81c-39f4-4125-b286-1843ea1e5450]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:13 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.876s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:14 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e 1G Sep 23 00:25:14 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e 1G" returned: 0 in 1.133s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dc5e25-0aff-441c-a986-fbcc9be422dc -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dc5e25-0aff-441c-a986-fbcc9be422dc -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:15 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dc5e25-0aff-441c-a986-fbcc9be422dc -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.974s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e is being set with open permissions: ugo+rw Sep 23 00:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b5897fcd-6127-4287-b944-1c5b3d9802ed req-afe71154-d304-49d1-a8d4-fb1ba3d3e9c7 tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:16 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:16 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.685s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info Sep 23 00:25:17 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:17 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info is being set with open permissions: ugo+rw Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info Sep 23 00:25:17 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:17 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.info" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] snapshot: 5b666bb1-64d5-420b-aa7d-c58872172f9e, volume: fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fad5766-096d-45f6-90a8-6fd6815ab6ac]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:18 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.440s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88dc5e25-0aff-441c-a986-fbcc9be422dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9299bba-c845-46c9-9912-bde03dba5447]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:18 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:25:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc Sep 23 00:25:18 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:26 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=37,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:26 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=41,cinder:SELECT=25,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:27 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" returned: 0 in 8.175s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc, size 1024.00 MB, duration 8.18 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:27 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Converted 1024.00 MB image at 125.24 MB/s Sep 23 00:25:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc is being set with open permissions: ugo+rw Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc Sep 23 00:25:27 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" released by "_copy_volume_from_snapshot" :: held 9.516s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-5b666bb1-64d5-420b-aa7d-c58872172f9e" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-5b666bb1-64d5-420b-aa7d-c58872172f9e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Deleting offline snapshot 5b666bb1-64d5-420b-aa7d-c58872172f9e of volume 88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] snapshot_file for this snap is: volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2823572-babe-4dd8-9c78-63b4f4145b70]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:27 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88dc5e25-0aff-441c-a986-fbcc9be422dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf0425-f1aa-477d-970e-3d1dc80853f1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:28 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:28 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (d32bf420-a46b-4f41-ad85-c4e3cba00387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170c429-fa2e-4f27-b712-269b1cb5fe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7170c429-fa2e-4f27-b712-269b1cb5fe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-964083134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af51f911-af1d-45d2-b1cc-fa394d00aa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:28Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a982b7-58c1-446e-9ecd-6e09f82988c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a982b7-58c1-446e-9ecd-6e09f82988c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840f4930-e05c-44c5-8df1-a7a83d3c051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840f4930-e05c-44c5-8df1-a7a83d3c051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af51f911-af1d-45d2-b1cc-fa394d00aa30', 'volume_name': 'volume-af51f911-af1d-45d2-b1cc-fa394d00aa30', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f0aed5-f22b-4dd8-b951-948d88bdd618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f0aed5-f22b-4dd8-b951-948d88bdd618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d427d69-b57e-486c-8738-34a5e9124fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Volume af51f911-af1d-45d2-b1cc-fa394d00aa30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af51f911-af1d-45d2-b1cc-fa394d00aa30', 'volume_size': 1} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:28 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.632s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:28 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:29 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e Sep 23 00:25:29 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc.5b666bb1-64d5-420b-aa7d-c58872172f9e" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-5b666bb1-64d5-420b-aa7d-c58872172f9e" released by "_delete_snapshot" :: held 1.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.417s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.431s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175277291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f5687-481f-4c16-b8ed-71c99458b568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='741844807c084d0b82f97c1f9d89541c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:13Z,use_quota=True,user_id='a4ed91781ee649508b42b8917083c213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Creating volume 8f8f5687-481f-4c16-b8ed-71c99458b568 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107dd122-a076-4666-b794-62e2376c6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc', 'volume_size': 1, 'source_volid': '88dc5e25-0aff-441c-a986-fbcc9be422dc', 'source_volstatus': 'available'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:29 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 1073741824 Sep 23 00:25:29 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbe0f7f-2d2f-40e7-9cdb-ab8f9094549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Volume volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc (fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc): created successfully Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbe0f7f-2d2f-40e7-9cdb-ab8f9094549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (270e39a7-3aeb-476e-ab2a-dd1bfa5de834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7e1eac13-fa7f-4e7e-9ac3-b25e44d4565c tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:25:29 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 1073741824" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 Sep 23 00:25:30 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:30 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b5897fcd-6127-4287-b944-1c5b3d9802ed req-afe71154-d304-49d1-a8d4-fb1ba3d3e9c7 tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.193s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a5cb9a-c192-4e16-a052-24b42b8f68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8f5687-481f-4c16-b8ed-71c99458b568', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df89afe2-91d3-4e58-a0dc-14cb8d1513cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b5897fcd-6127-4287-b944-1c5b3d9802ed req-afe71154-d304-49d1-a8d4-fb1ba3d3e9c7 tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-964083134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af51f911-af1d-45d2-b1cc-fa394d00aa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f365d7420a3427fad5836097b0543e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:28Z,use_quota=True,user_id='27b9dadb93c44b688abe7c1195bbb01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Creating volume af51f911-af1d-45d2-b1cc-fa394d00aa30 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Volume volume-8f8f5687-481f-4c16-b8ed-71c99458b568 (8f8f5687-481f-4c16-b8ed-71c99458b568): created successfully Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df89afe2-91d3-4e58-a0dc-14cb8d1513cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 1073741824 Sep 23 00:25:30 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Flow 'volume_create_manager' (820fb080-7a4c-424c-a1ef-84920ecf006d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-45ec95cb-9e39-4210-9f1a-1afd39f29108 tempest-ProjectReaderTests-1358139249 None] Created volume successfully. Sep 23 00:25:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b5897fcd-6127-4287-b944-1c5b3d9802ed req-afe71154-d304-49d1-a8d4-fb1ba3d3e9c7 tempest-TestMinimumBasicScenario-1944249495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-d684d109-21bf-49b4-8c0f-5cc36feab3da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a390fd1-444f-4905-b240-70b055af0a6f', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b5897fcd-6127-4287-b944-1c5b3d9802ed req-afe71154-d304-49d1-a8d4-fb1ba3d3e9c7 tempest-TestMinimumBasicScenario-1944249495 None] attachment_update completed successfully. Sep 23 00:25:31 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 1073741824" returned: 0 in 0.674s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:31 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 Sep 23 00:25:31 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Acquiring lock "cinder-8f8f5687-481f-4c16-b8ed-71c99458b568-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "cinder-8f8f5687-481f-4c16-b8ed-71c99458b568-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (b9b597e8-39db-4d04-8f8d-bdcdd702a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d79fc-33cc-4d74-aef4-be4dbd9aa433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949d79fc-33cc-4d74-aef4-be4dbd9aa433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-415455225',display_name='tempest-VolumesGetTest-Volume-646422558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f253f9fb-50a5-467a-9462-bc222272af8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:32Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afd4612-94b1-4f69-9376-c935bec00255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afd4612-94b1-4f69-9376-c935bec00255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ceeba-66c2-47ff-a5fa-55064f077c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ceeba-66c2-47ff-a5fa-55064f077c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f253f9fb-50a5-467a-9462-bc222272af8a', 'volume_name': 'volume-f253f9fb-50a5-467a-9462-bc222272af8a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a20750-5cb8-46f9-8834-d0de89cd3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a20750-5cb8-46f9-8834-d0de89cd3d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd99fb6-1204-4b62-876f-c0f6aa289eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Volume f253f9fb-50a5-467a-9462-bc222272af8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f253f9fb-50a5-467a-9462-bc222272af8a', 'volume_size': 1} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30" returned: 0 in 0.683s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-415455225',display_name='tempest-VolumesGetTest-Volume-646422558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f253f9fb-50a5-467a-9462-bc222272af8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:32Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Creating volume f253f9fb-50a5-467a-9462-bc222272af8a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Acquiring lock "cinder-quobyte-8f8f5687-481f-4c16-b8ed-71c99458b568" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:31 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a 1073741824 Sep 23 00:25:31 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d427d69-b57e-486c-8738-34a5e9124fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af51f911-af1d-45d2-b1cc-fa394d00aa30', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0064dab3-5c86-43b4-bb11-513a9f755ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "cinder-quobyte-8f8f5687-481f-4c16-b8ed-71c99458b568" acquired by "delete_volume" :: waited 0.058s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Volume volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 (af51f911-af1d-45d2-b1cc-fa394d00aa30): created successfully Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0064dab3-5c86-43b4-bb11-513a9f755ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Flow 'volume_create_manager' (d32bf420-a46b-4f41-ad85-c4e3cba00387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bf697-0699-421c-a68a-0faf473afd1a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d44edb93-2576-4710-a544-4e29bfe6cf12 tempest-AttachVolumeNegativeTest-933588799 None] Created volume successfully. Sep 23 00:25:32 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 Sep 23 00:25:32 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568 Sep 23 00:25:32 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a 1073741824" returned: 0 in 0.828s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a Sep 23 00:25:32 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8f8f5687-481f-4c16-b8ed-71c99458b568" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "cinder-quobyte-8f8f5687-481f-4c16-b8ed-71c99458b568" released by "delete_volume" :: held 1.123s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:33 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a" returned: 0 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd99fb6-1204-4b62-876f-c0f6aa289eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f253f9fb-50a5-467a-9462-bc222272af8a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f815dd-3bae-45db-ab85-151ff5f51e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Created reservations ['b09b8efd-4d44-4811-a3cc-700a68f1b2f8', 'b474893c-6222-43ae-8d35-e29bb832910e', '9d5470b1-69ac-4603-b84f-d1607aedf879', '9a09d1ff-e4fe-4d2d-a435-a8d7e109837d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Volume volume-f253f9fb-50a5-467a-9462-bc222272af8a (f253f9fb-50a5-467a-9462-bc222272af8a): created successfully Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f815dd-3bae-45db-ab85-151ff5f51e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (b9b597e8-39db-4d04-8f8d-bdcdd702a79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e80daab9-63dc-4a89-a5eb-3b618be5444a tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:33 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-f253f9fb-50a5-467a-9462-bc222272af8a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "cinder-f253f9fb-50a5-467a-9462-bc222272af8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-f253f9fb-50a5-467a-9462-bc222272af8a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-f253f9fb-50a5-467a-9462-bc222272af8a" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[64afcdce-5f4f-4952-a401-3970562309b0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.683s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Deleted volume successfully. Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-353f4218-0b72-4fbe-aad6-61ee465dc49a tempest-ProjectReaderTests-1358139249 None] Lock "cinder-8f8f5687-481f-4c16-b8ed-71c99458b568-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:34 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a Sep 23 00:25:34 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-15a77926-cdaa-41af-a3eb-cf5ed7a81f15 req-075d6cfa-2158-4fcf-9a5f-6090536f36ab tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-15a77926-cdaa-41af-a3eb-cf5ed7a81f15 req-075d6cfa-2158-4fcf-9a5f-6090536f36ab tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-15a77926-cdaa-41af-a3eb-cf5ed7a81f15 req-075d6cfa-2158-4fcf-9a5f-6090536f36ab tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-15a77926-cdaa-41af-a3eb-cf5ed7a81f15 req-075d6cfa-2158-4fcf-9a5f-6090536f36ab tempest-AttachVolumeNegativeTest-933588799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-af51f911-af1d-45d2-b1cc-fa394d00aa30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e19b0f-750b-4d50-87f8-c743338c109e', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-15a77926-cdaa-41af-a3eb-cf5ed7a81f15 req-075d6cfa-2158-4fcf-9a5f-6090536f36ab tempest-AttachVolumeNegativeTest-933588799 None] attachment_update completed successfully. Sep 23 00:25:34 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a" returned: 0 in 0.677s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a Sep 23 00:25:34 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f253f9fb-50a5-467a-9462-bc222272af8a" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-f253f9fb-50a5-467a-9462-bc222272af8a" released by "delete_volume" :: held 1.251s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Created reservations ['358834a7-1728-4267-a7ed-d28f8e16005c', '2d544720-39b7-4405-9061-6aca88cec469', '086fa04c-5dd3-4eb3-a67b-33843f2823cb', 'f53ecd9f-e3db-4928-91fc-1d4b1fc737d4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:35 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-63dde738-c9e2-4c68-8c95-c1077ad53bf8 tempest-VolumesGetTest-848985921 None] Lock "cinder-f253f9fb-50a5-467a-9462-bc222272af8a-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "cinder-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a43c9e-8b25-4aa9-8307-52bff67d62a3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc Sep 23 00:25:37 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" returned: 0 in 0.648s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc Sep 23 00:25:37 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-9f5b51cf-c58d-4ab5-9045-b79377be0488 req-437b0f60-8bad-4d5f-ada1-7452eec7b0b2 tempest-AttachVolumeNegativeTest-933588799 None] Terminate volume connection completed successfully. Sep 23 00:25:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-9f5b51cf-c58d-4ab5-9045-b79377be0488 req-437b0f60-8bad-4d5f-ada1-7452eec7b0b2 tempest-AttachVolumeNegativeTest-933588799 None] Deleting attachment e6e19b0f-750b-4d50-87f8-c743338c109e. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:38 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc" released by "delete_volume" :: held 1.193s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Created reservations ['b1f4af4f-41a8-4579-9680-082464272611', '5e20d609-986b-44ce-97ee-a3d8c6c9d6b7', 'f39a181d-d1d1-4bd2-a51d-1167669f3c0c', 'f39f37ba-93f2-4989-a5ba-21340e208d2d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:38 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-57efc82b-6473-438a-a3e6-0def62e0cb6e tempest-VolumesGetTest-848985921 None] Lock "cinder-fa7c2092-c928-4aa4-ba1e-9f0a2c1b03cc-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-88dc5e25-0aff-441c-a986-fbcc9be422dc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "cinder-88dc5e25-0aff-441c-a986-fbcc9be422dc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-88dc5e25-0aff-441c-a986-fbcc9be422dc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-88dc5e25-0aff-441c-a986-fbcc9be422dc" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d77a39-5502-4177-a974-10146921be39]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:39 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:39 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:40 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:40 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc Sep 23 00:25:40 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:40 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-88dc5e25-0aff-441c-a986-fbcc9be422dc" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-88dc5e25-0aff-441c-a986-fbcc9be422dc" released by "delete_volume" :: held 0.979s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Created reservations ['ebc6cfa2-2b31-4ed9-a30d-a4cde6d744f5', 'a221d55f-865e-4263-b597-5a22a9ee33d3', '00fd6f5e-afe3-4876-a419-1db9a1ebf73a', 'e196aaf3-a8fb-4f7b-9481-ac3917d11d46'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:40 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:40 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:41 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f707da9-fecb-4b80-8fa3-1c368eedb4cc tempest-VolumesGetTest-848985921 None] Lock "cinder-88dc5e25-0aff-441c-a986-fbcc9be422dc-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (819a3e38-b99d-47c6-8045-e49d04c0a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbd06a3-7132-4af2-aaa9-fc199d4587a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbd06a3-7132-4af2-aaa9-fc199d4587a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1651168055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93aa106-87d8-450d-80f4-ef6d967edb1d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dac5333-33ca-460a-b35c-79dc380957da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dac5333-33ca-460a-b35c-79dc380957da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd126d2-3732-43bd-8134-4ca160860381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd126d2-3732-43bd-8134-4ca160860381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b93aa106-87d8-450d-80f4-ef6d967edb1d', 'volume_name': 'volume-b93aa106-87d8-450d-80f4-ef6d967edb1d', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825b1626-7a04-4422-a403-916610790297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825b1626-7a04-4422-a403-916610790297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffb0054-e5ab-4fb1-a647-34232baed067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Volume b93aa106-87d8-450d-80f4-ef6d967edb1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b93aa106-87d8-450d-80f4-ef6d967edb1d', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:25:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Trying to clone b93aa106-87d8-450d-80f4-ef6d967edb1d from image 7ff22cbd-c151-45fd-8a05-f05c376811bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:25:44 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b42fa29-975a-452b-b2f7-228ba5b74642]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-af51f911-af1d-45d2-b1cc-fa394d00aa30-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-af51f911-af1d-45d2-b1cc-fa394d00aa30-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:44 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD Sep 23 00:25:44 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-quobyte-af51f911-af1d-45d2-b1cc-fa394d00aa30" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-af51f911-af1d-45d2-b1cc-fa394d00aa30" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa89732-ecd4-45d9-86a6-105bc157d8c0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 Sep 23 00:25:44 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc is fetched for user f0c7472cbe144778aeac648bd0701eac. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec9507f-3d1a-4796-900e-f9e810fe375a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD Sep 23 00:25:45 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:45 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30" returned: 0 in 0.694s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30 Sep 23 00:25:45 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:45 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1651168055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93aa106-87d8-450d-80f4-ef6d967edb1d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Creating volume b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1073741824 Sep 23 00:25:45 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:45 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-af51f911-af1d-45d2-b1cc-fa394d00aa30" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-af51f911-af1d-45d2-b1cc-fa394d00aa30" released by "delete_volume" :: held 1.230s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Created reservations ['b89aa505-a587-462d-a7e6-2e8473738f4d', '2d741d5e-fe3e-40c4-b803-6fbbb38b45aa', 'c86d3a01-bb8f-4c15-bb68-abcf20854a86', '839fad0b-cc0f-43cc-a6ae-11c478c44698'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:46 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1073741824" returned: 0 in 0.633s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d Sep 23 00:25:46 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Deleted volume successfully. Sep 23 00:25:46 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d" returned: 0 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e0e4bc7f-e378-4189-9e69-9b372e1d5bc4 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-af51f911-af1d-45d2-b1cc-fa394d00aa30-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Attempting download of 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume b93aa106-87d8-450d-80f4-ef6d967edb1d. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c5af56-0212-4b3a-b1c6-e71a6b51691a]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw Sep 23 00:25:46 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-f4a5e593-d05a-46ad-8334-b371ee08bb96-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-f4a5e593-d05a-46ad-8334-b371ee08bb96-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-quobyte-f4a5e593-d05a-46ad-8334-b371ee08bb96" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-f4a5e593-d05a-46ad-8334-b371ee08bb96" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2582a1da-90d9-4b8c-a50a-291d6729dca5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 Sep 23 00:25:47 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw Sep 23 00:25:47 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw" returned: 1 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ff22cbd-c151-45fd-8a05-f05c376811bc_hznh58iw' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba00c29-7da4-48fc-93c0-f6a922770794]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96 Sep 23 00:25:47 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD Sep 23 00:25:47 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f4a5e593-d05a-46ad-8334-b371ee08bb96" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-f4a5e593-d05a-46ad-8334-b371ee08bb96" released by "delete_volume" :: held 0.880s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Created reservations ['89386153-410d-456b-ac8e-09d8c91b2756', '79414e84-20d2-41b2-87da-fa3dc2ecd2dc', '919c883f-6ad7-463d-84ca-7f2c9066abc5', '96ca13b8-5c3f-4193-865b-dbcfa25100b9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:48 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] 7ff22cbd-c151-45fd-8a05-f05c376811bc was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:48 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:48 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-e834184d-ca98-44f9-9a7c-b26a6828ab33-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-e834184d-ca98-44f9-9a7c-b26a6828ab33-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "cinder-quobyte-e834184d-ca98-44f9-9a7c-b26a6828ab33" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-e834184d-ca98-44f9-9a7c-b26a6828ab33" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c6d28-e7ea-4b3f-b750-bc227aff2810]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Deleted volume successfully. Sep 23 00:25:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e17df43e-3b6c-4de7-9178-9e1b6084f8b1 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-f4a5e593-d05a-46ad-8334-b371ee08bb96-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:48 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 Sep 23 00:25:48 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33 Sep 23 00:25:49 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e834184d-ca98-44f9-9a7c-b26a6828ab33" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-quobyte-e834184d-ca98-44f9-9a7c-b26a6828ab33" released by "delete_volume" :: held 0.995s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Created reservations ['0e46bbae-b8fe-4f68-b902-b773e9253e70', '1cef6b64-7802-4430-aea7-6e2de2561f12', '9b60febe-d96b-4d48-a0fb-40cd5145722c', '52cc3459-98bf-4f73-9c23-081e65cf74af'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:49 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:49 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Deleted volume successfully. Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f0c09866-9ae4-4bac-a89a-12f9c97840a8 tempest-AttachVolumeNegativeTest-933588799 None] Lock "cinder-e834184d-ca98-44f9-9a7c-b26a6828ab33-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:50 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:50 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d" returned: 0 in 2.843s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ff22cbd-c151-45fd-8a05-f05c376811bc_yzzyi2nhdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:50 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Converted 112.00 MB image at 39.37 MB/s Sep 23 00:25:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1G Sep 23 00:25:50 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d 1G" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Downloaded image 7ff22cbd-c151-45fd-8a05-f05c376811bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}])) to volume b93aa106-87d8-450d-80f4-ef6d967edb1d successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Temporary image 7ff22cbd-c151-45fd-8a05-f05c376811bc for user f0c7472cbe144778aeac648bd0701eac is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Marking volume b93aa106-87d8-450d-80f4-ef6d967edb1d as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Copying metadata from image 7ff22cbd-c151-45fd-8a05-f05c376811bc to b93aa106-87d8-450d-80f4-ef6d967edb1d. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Creating volume glance metadata for volume b93aa106-87d8-450d-80f4-ef6d967edb1d backed by image 7ff22cbd-c151-45fd-8a05-f05c376811bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffb0054-e5ab-4fb1-a647-34232baed067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93aa106-87d8-450d-80f4-ef6d967edb1d', 'volume_size': 1, 'image_id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ff22cbd-c151-45fd-8a05-f05c376811bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07b19499b24f4f3eaa290ba4afc912c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ff22cbd-c151-45fd-8a05-f05c376811bc', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ff22cbd-c151-45fd-8a05-f05c376811bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd1327a-16b2-4111-b180-aa9975a8a855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Volume volume-b93aa106-87d8-450d-80f4-ef6d967edb1d (b93aa106-87d8-450d-80f4-ef6d967edb1d): created successfully Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd1327a-16b2-4111-b180-aa9975a8a855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (819a3e38-b99d-47c6-8045-e49d04c0a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9fa03745-444b-45d3-ba1e-3677ae240492 tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (3c0a44ec-b8bf-4fb2-b36f-901717fb9d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3131ca-c23b-413a-8aa7-98b4edf3ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3131ca-c23b-413a-8aa7-98b4edf3ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-698893567',display_name='tempest-VolumesGetTest-Volume-218657272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0865f958-1074-4ea0-b325-59e9670b3e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:53Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af010b-2b4a-407f-a0fe-e99801aa43ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af010b-2b4a-407f-a0fe-e99801aa43ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8e5994-b42e-4ea5-9b4d-dbedc97dfe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8e5994-b42e-4ea5-9b4d-dbedc97dfe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0865f958-1074-4ea0-b325-59e9670b3e80', 'volume_name': 'volume-0865f958-1074-4ea0-b325-59e9670b3e80', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de039a5c-c6d3-4770-bf2c-1fa6a79bce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de039a5c-c6d3-4770-bf2c-1fa6a79bce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c4fc36-8bfb-4b40-a2d8-608cde90a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Volume 0865f958-1074-4ea0-b325-59e9670b3e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0865f958-1074-4ea0-b325-59e9670b3e80', 'volume_size': 1} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-698893567',display_name='tempest-VolumesGetTest-Volume-218657272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0865f958-1074-4ea0-b325-59e9670b3e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d418e0082b468eae6c15d13c4e5ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:53Z,use_quota=True,user_id='f0c7472cbe144778aeac648bd0701eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Creating volume 0865f958-1074-4ea0-b325-59e9670b3e80 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:53 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 1073741824 Sep 23 00:25:53 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 1073741824" returned: 0 in 0.593s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 Sep 23 00:25:53 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c4fc36-8bfb-4b40-a2d8-608cde90a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0865f958-1074-4ea0-b325-59e9670b3e80', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c399ef04-8762-4282-9ffd-810f86d515f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Volume volume-0865f958-1074-4ea0-b325-59e9670b3e80 (0865f958-1074-4ea0-b325-59e9670b3e80): created successfully Sep 23 00:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c399ef04-8762-4282-9ffd-810f86d515f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Flow 'volume_create_manager' (3c0a44ec-b8bf-4fb2-b36f-901717fb9d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-076e6041-ca9c-41cf-9677-75d53736b434 tempest-VolumesGetTest-848985921 None] Created volume successfully. Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-0865f958-1074-4ea0-b325-59e9670b3e80-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "cinder-0865f958-1074-4ea0-b325-59e9670b3e80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-0865f958-1074-4ea0-b325-59e9670b3e80" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-0865f958-1074-4ea0-b325-59e9670b3e80" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2818a-25f0-4d3b-a2d4-c5a7761a4539]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 Sep 23 00:25:55 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80 Sep 23 00:25:55 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0865f958-1074-4ea0-b325-59e9670b3e80" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-0865f958-1074-4ea0-b325-59e9670b3e80" released by "delete_volume" :: held 0.960s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Created reservations ['ccb592ac-75e2-494c-b1eb-26b65295221f', 'b30e90a2-cac7-4dca-acae-1d3528b8c0df', 'df5ca19a-034d-47d6-a87a-70e388c11ac6', '3dde79a7-b97c-4a49-ab05-f3c61f7fac26'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:56 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ac235cc-0a00-426f-b1ab-05a747fd8fa7 tempest-VolumesGetTest-848985921 None] Lock "cinder-0865f958-1074-4ea0-b325-59e9670b3e80-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-b93aa106-87d8-450d-80f4-ef6d967edb1d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "cinder-b93aa106-87d8-450d-80f4-ef6d967edb1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Acquiring lock "cinder-quobyte-b93aa106-87d8-450d-80f4-ef6d967edb1d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-b93aa106-87d8-450d-80f4-ef6d967edb1d" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792a0b2-39d5-4ce6-b392-473ca0344521]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d Sep 23 00:25:57 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d" returned: 0 in 0.650s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d Sep 23 00:25:58 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b93aa106-87d8-450d-80f4-ef6d967edb1d" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "cinder-quobyte-b93aa106-87d8-450d-80f4-ef6d967edb1d" released by "delete_volume" :: held 1.102s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Created reservations ['f738dd1e-0e07-4096-965e-c7d59db07952', '84a85b44-0cee-4650-99bc-e03e7a128286', '9784ece9-439d-4e2d-9429-3b7f4a6d3348', 'a5728961-919e-4906-abe0-85eca4b423a2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:25:59 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Deleted volume successfully. Sep 23 00:25:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-258fb4d9-3501-49f6-a315-99477a4cd28b tempest-VolumesGetTest-848985921 None] Lock "cinder-b93aa106-87d8-450d-80f4-ef6d967edb1d-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (6c6a4a87-f2f6-459b-87a7-4f7f2721ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d43b12-71c4-4265-9cb1-7c42dfd7eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d43b12-71c4-4265-9cb1-7c42dfd7eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-127298045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529f27c6-181e-47a9-9175-7dc428996db6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:02Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009e0a05-9061-495e-bf4d-ec37ac90faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009e0a05-9061-495e-bf4d-ec37ac90faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27d04b8-500a-438a-a766-0de89a60ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27d04b8-500a-438a-a766-0de89a60ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529f27c6-181e-47a9-9175-7dc428996db6', 'volume_name': 'volume-529f27c6-181e-47a9-9175-7dc428996db6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765f7899-4f83-4359-9bf4-2a9faa9b7556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765f7899-4f83-4359-9bf4-2a9faa9b7556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b598d0-a342-4e5e-a061-68d80bebc5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Volume 529f27c6-181e-47a9-9175-7dc428996db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529f27c6-181e-47a9-9175-7dc428996db6', 'volume_size': 1} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-127298045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529f27c6-181e-47a9-9175-7dc428996db6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:02Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Creating volume 529f27c6-181e-47a9-9175-7dc428996db6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 1073741824 Sep 23 00:26:02 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 1073741824" returned: 0 in 0.779s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 Sep 23 00:26:02 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:03 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b598d0-a342-4e5e-a061-68d80bebc5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529f27c6-181e-47a9-9175-7dc428996db6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064379e1-ed89-405a-86b7-6a06509fa300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Volume volume-529f27c6-181e-47a9-9175-7dc428996db6 (529f27c6-181e-47a9-9175-7dc428996db6): created successfully Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064379e1-ed89-405a-86b7-6a06509fa300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (6c6a4a87-f2f6-459b-87a7-4f7f2721ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8df93030-5ab4-4fca-82ff-d54e4ae0de16 tempest-VolumesTestJSON-2070890764 None] Created volume successfully. Sep 23 00:26:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (09ff3ea5-8bb0-4336-be53-e486adc5d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a0f44-79f3-429c-84eb-d30aa2ec13cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a0f44-79f3-429c-84eb-d30aa2ec13cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760773688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21229ce1-6d89-45b0-ae6a-9b552d3ab4ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:05Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c6a0f9-cb09-471d-bcd5-5e88c435d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c6a0f9-cb09-471d-bcd5-5e88c435d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5cb4b2-083f-4eec-9abb-24f9b181976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5cb4b2-083f-4eec-9abb-24f9b181976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21229ce1-6d89-45b0-ae6a-9b552d3ab4ae', 'volume_name': 'volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f1c47-353b-42ec-8e55-8b9e736b106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3f1c47-353b-42ec-8e55-8b9e736b106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e802b0-335a-4969-bba9-2bfd457f93a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Volume 21229ce1-6d89-45b0-ae6a-9b552d3ab4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae', 'volume_size': 1} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760773688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21229ce1-6d89-45b0-ae6a-9b552d3ab4ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:05Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Creating volume 21229ce1-6d89-45b0-ae6a-9b552d3ab4ae {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:05 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae 1073741824 Sep 23 00:26:05 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae 1073741824" returned: 0 in 0.754s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:06 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae Sep 23 00:26:06 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:06 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e802b0-335a-4969-bba9-2bfd457f93a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d9381-c572-4703-9e4f-becb7de778e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Volume volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae (21229ce1-6d89-45b0-ae6a-9b552d3ab4ae): created successfully Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178d9381-c572-4703-9e4f-becb7de778e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (09ff3ea5-8bb0-4336-be53-e486adc5d794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d8fc3565-72f7-4b20-bf04-7e08694531c1 tempest-VolumesTestJSON-2070890764 None] Created volume successfully. Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (96aa5ad9-b49e-408e-9e19-51c2ebce657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679a26b-00fc-4cc8-a227-770a6235cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679a26b-00fc-4cc8-a227-770a6235cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-360297511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea242c97-1290-41dd-9e1f-ab9839faaa20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:08Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133b756b-87e8-49d4-9b7b-f25ad1e9c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133b756b-87e8-49d4-9b7b-f25ad1e9c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df050b0-096a-4d45-9424-e28b83c4c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df050b0-096a-4d45-9424-e28b83c4c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea242c97-1290-41dd-9e1f-ab9839faaa20', 'volume_name': 'volume-ea242c97-1290-41dd-9e1f-ab9839faaa20', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c06879f-9f0e-45e7-8806-7f26fc60b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c06879f-9f0e-45e7-8806-7f26fc60b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532d3cec-b7f1-423e-86a0-fc2fc738516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Volume ea242c97-1290-41dd-9e1f-ab9839faaa20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea242c97-1290-41dd-9e1f-ab9839faaa20', 'volume_size': 1} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-360297511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea242c97-1290-41dd-9e1f-ab9839faaa20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3672d53b50c94875a164e4cc1e433b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:08Z,use_quota=True,user_id='ae23a1d0ba9b4d188d5f8bcedf09e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Creating volume ea242c97-1290-41dd-9e1f-ab9839faaa20 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:07 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 1073741824 Sep 23 00:26:07 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 1073741824" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:08 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 Sep 23 00:26:08 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532d3cec-b7f1-423e-86a0-fc2fc738516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea242c97-1290-41dd-9e1f-ab9839faaa20', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9222296c-6967-4f4c-8487-f877109183d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Volume volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 (ea242c97-1290-41dd-9e1f-ab9839faaa20): created successfully Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9222296c-6967-4f4c-8487-f877109183d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Flow 'volume_create_manager' (96aa5ad9-b49e-408e-9e19-51c2ebce657b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c836b16b-e6dd-4ab9-9d16-c6ea14f78e4a tempest-VolumesTestJSON-2070890764 None] Created volume successfully. Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-ea242c97-1290-41dd-9e1f-ab9839faaa20-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "cinder-ea242c97-1290-41dd-9e1f-ab9839faaa20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-quobyte-ea242c97-1290-41dd-9e1f-ab9839faaa20" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-ea242c97-1290-41dd-9e1f-ab9839faaa20" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[15826b0c-7a8d-4fc7-ad46-48496fb7902e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 Sep 23 00:26:11 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20" returned: 0 in 0.520s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20 Sep 23 00:26:11 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ea242c97-1290-41dd-9e1f-ab9839faaa20" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-ea242c97-1290-41dd-9e1f-ab9839faaa20" released by "delete_volume" :: held 0.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Created reservations ['564bcf76-d34b-4698-aa50-a21d31df4200', '15d3f072-5f57-4956-82e3-67afc3313177', '250bbfd3-7a71-4115-bfcc-ac3e15135b03', '9bc376b6-d070-4da1-b8c4-0e2d66d913d2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:12 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:12 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "cinder-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-quobyte-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4481758a-bb48-441d-8723-4599195b86ba]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:12 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae Sep 23 00:26:12 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Deleted volume successfully. Sep 23 00:26:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-84d6b896-6273-4030-9ae3-3979727f9458 tempest-VolumesTestJSON-2070890764 None] Lock "cinder-ea242c97-1290-41dd-9e1f-ab9839faaa20-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:13 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae Sep 23 00:26:13 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae" released by "delete_volume" :: held 0.927s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Created reservations ['1e6d053e-80e8-4e8f-8808-f2f4fe34b138', '9adf7be0-488d-4d3b-90bd-c79bd7f72df1', '2898abf0-4b8d-484f-b5ee-6e8981da42fb', '36349043-d9c1-42d0-a373-94550ff1ad57'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:13 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Deleted volume successfully. Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a55025cc-61de-4eab-a8e9-69311b1f03fa tempest-VolumesTestJSON-2070890764 None] Lock "cinder-21229ce1-6d89-45b0-ae6a-9b552d3ab4ae-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-529f27c6-181e-47a9-9175-7dc428996db6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "cinder-529f27c6-181e-47a9-9175-7dc428996db6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Acquiring lock "cinder-quobyte-529f27c6-181e-47a9-9175-7dc428996db6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-529f27c6-181e-47a9-9175-7dc428996db6" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0bb279-93cc-40d9-888f-9fe431c8f49a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 Sep 23 00:26:15 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6 Sep 23 00:26:15 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-529f27c6-181e-47a9-9175-7dc428996db6" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "cinder-quobyte-529f27c6-181e-47a9-9175-7dc428996db6" released by "delete_volume" :: held 0.932s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Created reservations ['ce8cbfa5-706f-4b86-858f-8d43ecb01680', 'f192b044-9f24-4c55-ac6d-0c079aa6bc6d', 'bad64314-7fda-4502-95e2-873d32303d5b', 'a6e5e119-d9be-4454-bed1-458c5d36390e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:16 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Deleted volume successfully. Sep 23 00:26:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c8a9d38d-f5a9-41bd-af26-361edb874d5b tempest-VolumesTestJSON-2070890764 None] Lock "cinder-529f27c6-181e-47a9-9175-7dc428996db6-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (4fcfdf56-683f-43f4-abe5-dac89a7b4c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11475ff-5e67-4438-ab8d-1a9443960585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11475ff-5e67-4438-ab8d-1a9443960585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1712132419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decbd042-30e3-4f0a-ac9d-f13dd9eb71d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:19Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336c39b9-7f55-40c8-af02-4fcb3098a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336c39b9-7f55-40c8-af02-4fcb3098a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c461e8-aad3-42df-b08b-ddb5e9fb8c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c461e8-aad3-42df-b08b-ddb5e9fb8c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decbd042-30e3-4f0a-ac9d-f13dd9eb71d7', 'volume_name': 'volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f50940-7d23-4c10-b5b4-ace8841a2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f50940-7d23-4c10-b5b4-ace8841a2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710d9186-7944-4253-826c-73f5618e2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Volume decbd042-30e3-4f0a-ac9d-f13dd9eb71d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7', 'volume_size': 1} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1712132419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decbd042-30e3-4f0a-ac9d-f13dd9eb71d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:19Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Creating volume decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 1073741824 Sep 23 00:26:19 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:19 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 1073741824" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 Sep 23 00:26:19 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710d9186-7944-4253-826c-73f5618e2a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8807249-e538-4295-bd3d-88b9be45f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Volume volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 (decbd042-30e3-4f0a-ac9d-f13dd9eb71d7): created successfully Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8807249-e538-4295-bd3d-88b9be45f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (4fcfdf56-683f-43f4-abe5-dac89a7b4c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b55eb1b5-dddd-4c11-b9d3-a0863c6a71bb tempest-VolumesSnapshotTestJSON-1001097116 None] Created volume successfully. Sep 23 00:26:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Creating offline snapshot 77458e10-c08c-424e-8121-2702d7762b1c of volume decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1570fd-015a-49b0-8f2b-7c340e534755]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 Sep 23 00:26:21 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:22 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" returned: 0 in 0.644s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:22 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c 1G Sep 23 00:26:22 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:23 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c 1G" returned: 0 in 0.680s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c Sep 23 00:26:23 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:23 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:23 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c is being set with open permissions: ugo+rw Sep 23 00:26:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c Sep 23 00:26:23 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:24 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info Sep 23 00:26:24 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0a2357a0-e15f-46c5-8acc-4a55600d9cc9 req-02295829-334c-4baf-95fa-bfc0e598706e tempest-TestMinimumBasicScenario-1944249495 None] Terminate volume connection completed successfully. Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0a2357a0-e15f-46c5-8acc-4a55600d9cc9 req-02295829-334c-4baf-95fa-bfc0e598706e tempest-TestMinimumBasicScenario-1944249495 None] Deleting attachment 7a390fd1-444f-4905-b240-70b055af0a6f. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:26:24 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info is being set with open permissions: ugo+rw Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:24 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info Sep 23 00:26:24 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.info" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-77cc4393-c19a-421d-829e-1028b760eb5a tempest-VolumesSnapshotTestJSON-1001097116 None] Create snapshot completed successfully Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "cinder-d684d109-21bf-49b4-8c0f-5cc36feab3da-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "cinder-d684d109-21bf-49b4-8c0f-5cc36feab3da-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "cinder-quobyte-d684d109-21bf-49b4-8c0f-5cc36feab3da" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "cinder-quobyte-d684d109-21bf-49b4-8c0f-5cc36feab3da" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede630fb-2bd1-4a2b-be9b-ec45e9193735]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:25 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da Sep 23 00:26:25 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da" returned: 0 in 0.593s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da Sep 23 00:26:26 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-77458e10-c08c-424e-8121-2702d7762b1c-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-77458e10-c08c-424e-8121-2702d7762b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:26 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d684d109-21bf-49b4-8c0f-5cc36feab3da" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "cinder-quobyte-d684d109-21bf-49b4-8c0f-5cc36feab3da" released by "delete_volume" :: held 0.986s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-77458e10-c08c-424e-8121-2702d7762b1c" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-77458e10-c08c-424e-8121-2702d7762b1c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Deleting offline snapshot 77458e10-c08c-424e-8121-2702d7762b1c of volume decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] snapshot_file for this snap is: volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e34d0-abca-4ab3-b9f6-0ba6ffef3d20]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Created reservations ['da59d048-20d8-4bc4-9760-13e6a5cacc4e', '2d566b21-6760-4686-823a-f9082d538184', '4c3723f4-9d5b-4ef3-a67e-0e4f5c7ed750', '5c256d0b-eb04-4d58-be25-476d2c56a928'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:26 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:26 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:26 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Deleted volume successfully. Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=142,cinder:SELECT=116,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:27 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8508a4-2f8d-43f5-b5ff-b28ac0885c0e tempest-TestMinimumBasicScenario-1944249495 None] Lock "cinder-d684d109-21bf-49b4-8c0f-5cc36feab3da-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[975067c9-660c-44f2-89fa-800e155710c5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:27 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 Sep 23 00:26:27 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:27 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:27 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c Sep 23 00:26:27 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c Sep 23 00:26:28 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7.77458e10-c08c-424e-8121-2702d7762b1c" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-77458e10-c08c-424e-8121-2702d7762b1c" released by "_delete_snapshot" :: held 2.213s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" released by "delete_snapshot" :: held 2.250s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=114,cinder:UPDATE=140,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['8cf0d691-f70a-4a2a-8686-86b73f9a16f8', '5293a406-f5de-4526-90b9-b0403653cc4a', 'f6e98a97-d26e-4273-a00f-7f905a846328', 'b1054408-00b4-42ff-aa78-b15b88c9e52e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Delete snapshot completed successfully. Sep 23 00:26:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026cafd2-9ec3-440b-a8ff-66b2c1e1789d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-77458e10-c08c-424e-8121-2702d7762b1c-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f60d16f-8cff-40c8-88e6-d87a8290dd77 tempest-GroupSnapshotsV319Test-1090874694 None] Group tempest-GroupSnapshotsV319Test-Group-100935627: creating Sep 23 00:26:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f60d16f-8cff-40c8-88e6-d87a8290dd77 tempest-GroupSnapshotsV319Test-1090874694 None] Group tempest-GroupSnapshotsV319Test-Group-100935627: created successfully Sep 23 00:26:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f60d16f-8cff-40c8-88e6-d87a8290dd77 tempest-GroupSnapshotsV319Test-1090874694 None] Create group completed successfully. Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (fe5b123b-07bd-4a3d-9da7-9a772992616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdaf2cf-6b01-4d9e-80d6-7337bd196856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdaf2cf-6b01-4d9e-80d6-7337bd196856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742282987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8171b08e-606e-40db-b78d-17c4a5fbf661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:30Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefe12a-387f-42bf-973c-a33626b99143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefe12a-387f-42bf-973c-a33626b99143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3283854a-5c28-46ce-b1d1-ffda7df71a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3283854a-5c28-46ce-b1d1-ffda7df71a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8171b08e-606e-40db-b78d-17c4a5fbf661', 'volume_name': 'volume-8171b08e-606e-40db-b78d-17c4a5fbf661', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7f3e6-46db-4673-ab09-f5b1c592336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe7f3e6-46db-4673-ab09-f5b1c592336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fd7348-a323-438e-9db7-c7421cb523e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume 8171b08e-606e-40db-b78d-17c4a5fbf661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8171b08e-606e-40db-b78d-17c4a5fbf661', 'volume_size': 1} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742282987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8171b08e-606e-40db-b78d-17c4a5fbf661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:30Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Creating volume 8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:30 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 1073741824 Sep 23 00:26:30 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:30 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 1073741824" returned: 0 in 0.566s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:30 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Flow 'volume_create_manager' (9ce04684-9d8b-4807-8a09-c8766efde015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:31 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c768839-8c8d-43eb-845c-d19a3ae7d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c768839-8c8d-43eb-845c-d19a3ae7d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041234172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bbd8df8-0bc6-4cbf-805e-426134876e9f,host='devstack@QuobyteHD#QuobyteHD',id=466baa06-058c-4ee5-847c-c43601027c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e651bf636134402a8331421e787e76f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:31Z,use_quota=True,user_id='95316fd35f164ec5b156faa77d07c092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fecbc73-cb35-47ec-9106-2b1b8289ffe8),volume_type_id=0fecbc73-cb35-47ec-9106-2b1b8289ffe8)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e535fe-9343-4a7d-85f8-24c8a98e1686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e535fe-9343-4a7d-85f8-24c8a98e1686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a418e6b2-5453-42b6-9a2b-19e170b674b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a418e6b2-5453-42b6-9a2b-19e170b674b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466baa06-058c-4ee5-847c-c43601027c02', 'volume_name': 'volume-466baa06-058c-4ee5-847c-c43601027c02', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68b955-e0f2-405e-952d-eedaa0958f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68b955-e0f2-405e-952d-eedaa0958f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc85694-e94e-457b-a832-92e36247b37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Volume 466baa06-058c-4ee5-847c-c43601027c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466baa06-058c-4ee5-847c-c43601027c02', 'volume_size': 1} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6bbd8df8-0bc6-4cbf-805e-426134876e9f,created_at=2026-09-22T22:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041234172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6bbd8df8-0bc6-4cbf-805e-426134876e9f,host='devstack@QuobyteHD#QuobyteHD',id=466baa06-058c-4ee5-847c-c43601027c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e651bf636134402a8331421e787e76f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:31Z,use_quota=True,user_id='95316fd35f164ec5b156faa77d07c092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fecbc73-cb35-47ec-9106-2b1b8289ffe8),volume_type_id=0fecbc73-cb35-47ec-9106-2b1b8289ffe8)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Creating volume 466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fd7348-a323-438e-9db7-c7421cb523e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8171b08e-606e-40db-b78d-17c4a5fbf661', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4fdcc6-f679-4b71-b965-4cadfef2acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 1073741824 Sep 23 00:26:31 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume volume-8171b08e-606e-40db-b78d-17c4a5fbf661 (8171b08e-606e-40db-b78d-17c4a5fbf661): created successfully Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4fdcc6-f679-4b71-b965-4cadfef2acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (fe5b123b-07bd-4a3d-9da7-9a772992616c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-153d2843-d24a-4cdd-93f8-16625ebcb4a7 tempest-VolumesSnapshotTestJSON-1001097116 None] Created volume successfully. Sep 23 00:26:32 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 1073741824" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:32 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 Sep 23 00:26:32 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:32 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc85694-e94e-457b-a832-92e36247b37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466baa06-058c-4ee5-847c-c43601027c02', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df057723-e65b-410c-9adc-793f41065f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Volume volume-466baa06-058c-4ee5-847c-c43601027c02 (466baa06-058c-4ee5-847c-c43601027c02): created successfully Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df057723-e65b-410c-9adc-793f41065f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Flow 'volume_create_manager' (9ce04684-9d8b-4807-8a09-c8766efde015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1f3924b8-b86c-4849-931c-8d3eb65c9fa6 tempest-GroupSnapshotsV319Test-1090874694 None] Created volume successfully. Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Creating offline snapshot 5bff6d4d-3c0c-4279-809a-b4864920dfdf of volume 8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[643c905a-b0fa-4854-bca6-f2c4cd2e7f35]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:32 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:32 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf 1G Sep 23 00:26:33 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf 1G" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8171b08e-606e-40db-b78d-17c4a5fbf661 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8171b08e-606e-40db-b78d-17c4a5fbf661 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:33 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8171b08e-606e-40db-b78d-17c4a5fbf661 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf is being set with open permissions: ugo+rw Sep 23 00:26:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:33 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] GroupSnapshot c4d488be-cb43-4df0-9393-e4517498b159: creating. Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Group snapshot c4d488be-cb43-4df0-9393-e4517498b159: creating. {{(pid=87132) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:34 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info Sep 23 00:26:34 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info is being set with open permissions: ugo+rw Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info Sep 23 00:26:34 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.info" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.782s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Creating offline snapshot 517029db-03f9-4543-99fc-f216749bc5ef of volume 466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc337216-a2a7-47f2-ac3e-40d6dcd384c8 tempest-VolumesSnapshotTestJSON-1001097116 None] Create snapshot completed successfully Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f05e2d-3241-444f-8d6c-b2aa81dfb203]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 Sep 23 00:26:35 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef 1G Sep 23 00:26:35 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef 1G" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466baa06-058c-4ee5-847c-c43601027c02 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:36 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466baa06-058c-4ee5-847c-c43601027c02 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef Sep 23 00:26:36 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-466baa06-058c-4ee5-847c-c43601027c02 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:36 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:36 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef Sep 23 00:26:36 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (c9b51db7-312d-442b-a653-bea372a0cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e93589-3dc4-4824-8802-16bf2a2b67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e93589-3dc4-4824-8802-16bf2a2b67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-95753533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d782bbae-6cda-41e4-9a32-a0eaa80ec1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5bff6d4d-3c0c-4279-809a-b4864920dfdf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:37Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36f41c8-f54f-48b0-96a4-b05d65c9f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36f41c8-f54f-48b0-96a4-b05d65c9f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a5810b-1a37-41b7-8982-8c1ecde37f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a5810b-1a37-41b7-8982-8c1ecde37f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd782bbae-6cda-41e4-9a32-a0eaa80ec1fb', 'volume_name': 'volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb', 'volume_size': 2, 'snapshot_id': '5bff6d4d-3c0c-4279-809a-b4864920dfdf'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1507e9c1-ffb4-4d72-9b31-adb64e5657de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1507e9c1-ffb4-4d72-9b31-adb64e5657de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45c383e-b0d6-4178-a69a-7a7de8a86715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Volume d782bbae-6cda-41e4-9a32-a0eaa80ec1fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb', 'volume_size': 2, 'snapshot_id': '5bff6d4d-3c0c-4279-809a-b4864920dfdf'} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:36 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:36 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info Sep 23 00:26:36 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info Sep 23 00:26:37 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.info" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.698s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Creating volume d782bbae-6cda-41e4-9a32-a0eaa80ec1fb from snapshot 5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] snapshot: 5bff6d4d-3c0c-4279-809a-b4864920dfdf, volume: d782bbae-6cda-41e4-9a32-a0eaa80ec1fb, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[835edc35-f5d5-4c9c-b501-a7714f58e0b5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a367cda3-6551-4ef3-808e-e41101c00a4d tempest-GroupSnapshotsV319Test-1090874694 None] group_snapshot c4d488be-cb43-4df0-9393-e4517498b159: created successfully Sep 23 00:26:37 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:37 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.492s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8171b08e-606e-40db-b78d-17c4a5fbf661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f50e682-7080-4844-960b-32ede8aec891]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:38 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.569s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb Sep 23 00:26:38 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] group_snapshot c4d488be-cb43-4df0-9393-e4517498b159: deleting Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] group_snapshot c4d488be-cb43-4df0-9393-e4517498b159: deleting {{(pid=87132) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:26:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "cinder-quobyte-517029db-03f9-4543-99fc-f216749bc5ef" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-517029db-03f9-4543-99fc-f216749bc5ef" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Deleting offline snapshot 517029db-03f9-4543-99fc-f216749bc5ef of volume 466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] snapshot_file for this snap is: volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[150434fe-0e26-46b8-9af0-816dde0f2f23]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:39 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef Sep 23 00:26:39 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef" returned: 0 in 1.101s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-466baa06-058c-4ee5-847c-c43601027c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5317a9e-4c33-4a2b-bd51-0185fae198e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 Sep 23 00:26:40 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02" returned: 0 in 0.881s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:41 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef Sep 23 00:26:41 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef" returned: 0 in 0.868s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef Sep 23 00:26:42 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02.517029db-03f9-4543-99fc-f216749bc5ef" returned: 0 in 0.787s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-517029db-03f9-4543-99fc-f216749bc5ef" released by "_delete_snapshot" :: held 3.904s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" released by "delete_snapshot" :: held 3.945s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:43 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1176485298 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1176485298, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:43 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1176485298 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1176485298, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] Created reservations ['b1c70ba9-5de1-42d7-9984-aae5462f2753', '7c54a80a-7fdb-4591-bebf-5ad6ab5981e2', '4924e94d-69d7-48e5-b9bc-f6fa6f5166ab', '4eeb7c6d-5a4f-49fe-bb9a-4584470d6c8b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5048daa3-d4e3-4f97-8e8f-d79e7aa45a11 tempest-GroupSnapshotsV319Test-1090874694 None] group_snapshot c4d488be-cb43-4df0-9393-e4517498b159: deleted successfully Sep 23 00:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc5309-46f9-400f-bfb6-2428c0f85f9f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:44 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 Sep 23 00:26:44 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:45 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02" returned: 0 in 1.142s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:45 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02 Sep 23 00:26:45 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:46 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-466baa06-058c-4ee5-847c-c43601027c02" returned: 0 in 0.793s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "cinder-quobyte-466baa06-058c-4ee5-847c-c43601027c02" released by "delete_volume" :: held 2.168s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Created reservations ['647d90e8-6c0a-49b2-ae9d-4d7c464da473'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:46 devstack cinder-volume[87132]: WARNING cinder.quota [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1176485298 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1176485298, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Created reservations ['f5b2ed67-521e-4277-9642-5c31b333629d', '4e6a3660-8ea3-4afc-b4d8-13bc4462a4e8', '73d0782c-0364-49fa-999a-368e36924cce', 'f71a28ba-7de7-4a7c-942c-7f387ef191a6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:47 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:47 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:47 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.554s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-869ddd61-95f8-4d05-8839-79d8463862f7 tempest-GroupSnapshotsV319Test-1090874694 None] Delete group completed successfully. Sep 23 00:26:49 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" returned: 0 in 10.528s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661, size 1024.00 MB, duration 10.53 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:49 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Converted 1024.00 MB image at 97.25 MB/s Sep 23 00:26:49 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb is being set with open permissions: ugo+rw Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:49 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb Sep 23 00:26:49 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:49 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" released by "_copy_volume_from_snapshot" :: held 12.051s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" released by "_create_volume_from_snapshot" :: held 12.159s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.195s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45c383e-b0d6-4178-a69a-7a7de8a86715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb', 'volume_size': 2, 'snapshot_id': '5bff6d4d-3c0c-4279-809a-b4864920dfdf'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443e05d5-a288-4d82-b64a-b2cd92f35bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Volume volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb (d782bbae-6cda-41e4-9a32-a0eaa80ec1fb): created successfully Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443e05d5-a288-4d82-b64a-b2cd92f35bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (c9b51db7-312d-442b-a653-bea372a0cd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-294a9afc-f0d5-49ce-a94b-311730ce1eca tempest-VolumesSnapshotTestJSON-1001097116 None] Created volume successfully. Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:49 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:49 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:50 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.491s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c211ba-83fb-4877-b1ee-0f8da11400b3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb Sep 23 00:26:51 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" returned: 0 in 0.720s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb Sep 23 00:26:51 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb" released by "delete_volume" :: held 1.234s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['18969119-e82a-458e-b612-790600049805', '61a874b3-8115-4945-90b4-ad78b6092802', '075956eb-17db-4fb0-9a33-e957213af9d7', 'ee0ce882-9deb-4cc5-9740-1466941dd77a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:52 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Deleted volume successfully. Sep 23 00:26:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d89a098-267a-4474-8791-78140ce7fbe8 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-d782bbae-6cda-41e4-9a32-a0eaa80ec1fb-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-5bff6d4d-3c0c-4279-809a-b4864920dfdf-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-5bff6d4d-3c0c-4279-809a-b4864920dfdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Deleting offline snapshot 5bff6d4d-3c0c-4279-809a-b4864920dfdf of volume 8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] snapshot_file for this snap is: volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6193c2d9-762c-4af2-99c1-f3f4ef3a21e4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:53 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.664s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8171b08e-606e-40db-b78d-17c4a5fbf661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2c86b4-ed90-425a-a07a-f327fb3e29ac]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:54 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.990s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:55 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.580s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf Sep 23 00:26:55 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:56 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661.5bff6d4d-3c0c-4279-809a-b4864920dfdf" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-5bff6d4d-3c0c-4279-809a-b4864920dfdf" released by "_delete_snapshot" :: held 2.730s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" released by "delete_snapshot" :: held 2.764s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['bbf4867b-b3bb-4015-8930-493264972c6b', '49763e27-a771-4bc5-9388-2fc4a248c62a', '1efc304f-60f9-4aef-bfcd-488c66bca7ae', 'c9869013-5331-49f1-a2a6-4e89e612d953'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Delete snapshot completed successfully. Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-346cb4af-0e59-4a57-aabc-5d1b0f39b086 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-5bff6d4d-3c0c-4279-809a-b4864920dfdf-delete_snapshot" released by "delete_snapshot" :: held 3.019s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-8171b08e-606e-40db-b78d-17c4a5fbf661-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-8171b08e-606e-40db-b78d-17c4a5fbf661-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dca8e5-2a25-4493-9654-1974f086b108]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:57 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661 Sep 23 00:26:57 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8171b08e-606e-40db-b78d-17c4a5fbf661" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-8171b08e-606e-40db-b78d-17c4a5fbf661" released by "delete_volume" :: held 1.014s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['e94e15f6-5de8-48eb-ba99-4f344edb0e33', 'c3bbacee-59f7-4178-bb41-9826b8d79994', 'b463d2c5-03b3-4a2c-92b4-6f9dd9888a86', 'dc5724ba-8427-4154-96af-74956fe8076e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:26:58 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.460s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Deleted volume successfully. Sep 23 00:26:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1cbf64b-e105-4954-acbf-8827a840ea0e tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-8171b08e-606e-40db-b78d-17c4a5fbf661-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (6679f48b-84df-44a8-9fc6-881d4c2f406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc7f9df-3369-4c3f-8ad7-0bf67d385ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc7f9df-3369-4c3f-8ad7-0bf67d385ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679736597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68578d65-b292-4e14-afab-2059f945b2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:00Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1021a1df-93f8-4166-bc34-40b7426d91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1021a1df-93f8-4166-bc34-40b7426d91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e166c7-8f44-4e4a-8297-9127b8cd026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e166c7-8f44-4e4a-8297-9127b8cd026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68578d65-b292-4e14-afab-2059f945b2e5', 'volume_name': 'volume-68578d65-b292-4e14-afab-2059f945b2e5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15048d7d-fbe8-4eda-baf9-8891f98e925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15048d7d-fbe8-4eda-baf9-8891f98e925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3319c7-21ce-4ab7-bded-fd4d83cfb922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume 68578d65-b292-4e14-afab-2059f945b2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68578d65-b292-4e14-afab-2059f945b2e5', 'volume_size': 1} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679736597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68578d65-b292-4e14-afab-2059f945b2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:00Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Creating volume 68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:27:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:00 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 1073741824 Sep 23 00:27:00 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:01 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 1073741824" returned: 0 in 0.870s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:01 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:01 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:02 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3319c7-21ce-4ab7-bded-fd4d83cfb922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68578d65-b292-4e14-afab-2059f945b2e5', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb5e420-0999-4959-928e-9c65e95c099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Volume volume-68578d65-b292-4e14-afab-2059f945b2e5 (68578d65-b292-4e14-afab-2059f945b2e5): created successfully Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb5e420-0999-4959-928e-9c65e95c099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (6679f48b-84df-44a8-9fc6-881d4c2f406b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0f5ab26f-49c2-4f50-9624-ad8eb72e0c84 tempest-VolumesSnapshotTestJSON-1001097116 None] Created volume successfully. Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Creating offline snapshot d3b277aa-414c-4c67-8087-a49f84d30044 of volume 68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f9cbf-0f33-454c-a7b5-afe4c9960c35]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:03 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:03 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:03 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.688s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:03 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 1G Sep 23 00:27:03 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:04 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 1G" returned: 0 in 0.831s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68578d65-b292-4e14-afab-2059f945b2e5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:04 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68578d65-b292-4e14-afab-2059f945b2e5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:04 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:05 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68578d65-b292-4e14-afab-2059f945b2e5 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 is being set with open permissions: ugo+rw Sep 23 00:27:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:05 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:05 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:05 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:05 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info Sep 23 00:27:05 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:06 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:06 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info is being set with open permissions: ugo+rw Sep 23 00:27:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:06 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info Sep 23 00:27:06 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:06 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.info" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0513c188-63dc-4177-94f1-c1e526df0bf4 tempest-VolumesSnapshotTestJSON-1001097116 None] Create snapshot completed successfully Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (2623d4f7-e3ab-42d2-8d9e-ab3efb760488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e104dc-1ca3-4a29-9dfd-b9698911d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e104dc-1ca3-4a29-9dfd-b9698911d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1108949608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00589e3e-e11c-4484-a483-3ad90a820fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2b96450e4ea2b647d76395d7d012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3b277aa-414c-4c67-8087-a49f84d30044,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:08Z,use_quota=True,user_id='48f39ed86b9c4fc8a45b7403f44ad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9263d88d-5afc-4715-a7d7-ef740d8790c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9263d88d-5afc-4715-a7d7-ef740d8790c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6130e0db-3965-4160-ae30-22f264d52041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6130e0db-3965-4160-ae30-22f264d52041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00589e3e-e11c-4484-a483-3ad90a820fe6', 'volume_name': 'volume-00589e3e-e11c-4484-a483-3ad90a820fe6', 'volume_size': 1, 'snapshot_id': 'd3b277aa-414c-4c67-8087-a49f84d30044'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26aaca0-43e0-4ba1-93a3-203ec5862548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26aaca0-43e0-4ba1-93a3-203ec5862548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451c92fa-1045-404d-992d-d0a358e46bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Volume 00589e3e-e11c-4484-a483-3ad90a820fe6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00589e3e-e11c-4484-a483-3ad90a820fe6', 'volume_size': 1, 'snapshot_id': 'd3b277aa-414c-4c67-8087-a49f84d30044'} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044-00589e3e-e11c-4484-a483-3ad90a820fe6" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044-00589e3e-e11c-4484-a483-3ad90a820fe6" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Creating volume 00589e3e-e11c-4484-a483-3ad90a820fe6 from snapshot d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] snapshot: d3b277aa-414c-4c67-8087-a49f84d30044, volume: 00589e3e-e11c-4484-a483-3ad90a820fe6, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abd25da-c56d-4b54-9a51-c43e816412bb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:08 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:08 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68578d65-b292-4e14-afab-2059f945b2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba2acc-3029-4e71-826c-3bf8a1291d75]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:09 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:27:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 Sep 23 00:27:09 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=67,cinder:INSERT=16,cinder:UPDATE=65,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=56,cinder:INSERT=16,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:20 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6" returned: 0 in 10.408s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5, size 1024.00 MB, duration 10.41 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:20 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Converted 1024.00 MB image at 98.37 MB/s Sep 23 00:27:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 is being set with open permissions: ugo+rw Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:20 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 Sep 23 00:27:20 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:20 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" released by "_copy_volume_from_snapshot" :: held 11.988s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044-00589e3e-e11c-4484-a483-3ad90a820fe6" released by "_create_volume_from_snapshot" :: held 12.070s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.094s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451c92fa-1045-404d-992d-d0a358e46bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00589e3e-e11c-4484-a483-3ad90a820fe6', 'volume_size': 1, 'snapshot_id': 'd3b277aa-414c-4c67-8087-a49f84d30044'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc70491f-6d58-4fa9-ad99-e5d14385b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Volume volume-00589e3e-e11c-4484-a483-3ad90a820fe6 (00589e3e-e11c-4484-a483-3ad90a820fe6): created successfully Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc70491f-6d58-4fa9-ad99-e5d14385b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Flow 'volume_create_manager' (2623d4f7-e3ab-42d2-8d9e-ab3efb760488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6d5eb28f-f4b4-4fb0-abdc-f840243c5f5d tempest-VolumesSnapshotTestJSON-1001097116 None] Created volume successfully. Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-00589e3e-e11c-4484-a483-3ad90a820fe6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-00589e3e-e11c-4484-a483-3ad90a820fe6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" acquired by "delete_volume" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b7049-6ae3-4854-87dd-57ed59708579]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 Sep 23 00:27:21 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:21 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6" returned: 0 in 0.493s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6 Sep 23 00:27:21 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-00589e3e-e11c-4484-a483-3ad90a820fe6" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-00589e3e-e11c-4484-a483-3ad90a820fe6" released by "delete_volume" :: held 0.881s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['f33bff93-8928-4923-b3af-70f93c871323', '76369408-e11d-454a-a7b4-2a44b6b9e827', 'c68ab97e-f3f1-490b-9570-d32cdb650998', 'fb33ab8a-ae77-4792-8814-ff59bac973af'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:22 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-d3b277aa-414c-4c67-8087-a49f84d30044-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-d3b277aa-414c-4c67-8087-a49f84d30044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Deleting offline snapshot d3b277aa-414c-4c67-8087-a49f84d30044 of volume 68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] snapshot_file for this snap is: volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[25630078-ab4f-4a22-b67b-14b0553ddae7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Deleted volume successfully. Sep 23 00:27:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-69e8a0d0-b164-4973-85ad-907db6a664cd tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-00589e3e-e11c-4484-a483-3ad90a820fe6-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:22 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.518s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68578d65-b292-4e14-afab-2059f945b2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d55602-8c25-417b-8609-8a1e64019454]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:23 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:23 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:24 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.792s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:24 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:24 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.587s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044 Sep 23 00:27:24 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-477a03e6-dba8-475b-bc26-0f0f501d32e4 tempest-GroupsV320Test-1451207704 None] Group tempest-GroupsV320Test-Group-1932029180: creating Sep 23 00:27:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-477a03e6-dba8-475b-bc26-0f0f501d32e4 tempest-GroupsV320Test-1451207704 None] Group tempest-GroupsV320Test-Group-1932029180: created successfully Sep 23 00:27:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-477a03e6-dba8-475b-bc26-0f0f501d32e4 tempest-GroupsV320Test-1451207704 None] Create group completed successfully. Sep 23 00:27:25 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5.d3b277aa-414c-4c67-8087-a49f84d30044" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-d3b277aa-414c-4c67-8087-a49f84d30044" released by "_delete_snapshot" :: held 2.452s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" released by "delete_snapshot" :: held 2.490s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['daf5a90b-589f-4bad-9a85-d15233ee4038', '2254fbb0-bcac-4d89-ba40-a048a118fa8d', 'bc66d0bd-2b7d-4627-8036-99416ea2dff2', 'edc524d3-b7b6-4903-a797-40babb7aed03'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Delete snapshot completed successfully. Sep 23 00:27:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-93b5af3d-8e0e-401f-9ca3-ad2f1324a93b tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-d3b277aa-414c-4c67-8087-a49f84d30044-delete_snapshot" released by "delete_snapshot" :: held 2.706s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-68578d65-b292-4e14-afab-2059f945b2e5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-68578d65-b292-4e14-afab-2059f945b2e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cd881-829e-429f-83f5-c67f25de75e3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:26 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5 Sep 23 00:27:26 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Created reservations ['fa0fc7cc-071c-4811-93c2-18e44c68f984'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:27 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68578d65-b292-4e14-afab-2059f945b2e5" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-68578d65-b292-4e14-afab-2059f945b2e5" released by "delete_volume" :: held 1.066s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['6ba65a18-3008-4dd8-a27f-36600948eb69', '827b0188-f8f9-4ba4-a5b6-d9837a985040', '8509aef6-e668-4100-aa70-ddd4c4676253', 'd73bd973-4203-4a9b-b9bf-bcbfef01dcde'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:27 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-950698fe-c2cc-4b47-bb37-77456470b6e5 tempest-GroupsV320Test-1451207704 None] Delete group completed successfully. Sep 23 00:27:27 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Deleted volume successfully. Sep 23 00:27:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60e1e8cf-5ed2-447a-9a82-7f276688f449 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-68578d65-b292-4e14-afab-2059f945b2e5-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41d71bb-c17e-4992-877a-f25f30f867e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 Sep 23 00:27:29 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" returned: 0 in 0.787s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7 Sep 23 00:27:29 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-quobyte-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7" released by "delete_volume" :: held 1.347s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Created reservations ['dbc1cb11-1722-4c6e-80bd-5ba491b8c225', '8600eb68-0744-487f-97cb-d22951e8b7e3', '591c0f90-f542-403b-9240-380d6351c2f6', 'b234cc91-675c-4a3b-8034-a614fcfb7955'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:30 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Deleted volume successfully. Sep 23 00:27:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-38f14d07-2dd1-4e50-a03c-bda6a8add8d7 tempest-VolumesSnapshotTestJSON-1001097116 None] Lock "cinder-decbd042-30e3-4f0a-ac9d-f13dd9eb71d7-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Flow 'volume_create_manager' (214d4e51-32e2-46eb-b8cd-70c9a4d09e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df68a328-4978-45ab-9132-8d326ce48991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df68a328-4978-45ab-9132-8d326ce48991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1429638228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ce2a07-1234-4f10-866a-68443e9b5b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f7a4766e0f439899516bb6f35abc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:36Z,use_quota=True,user_id='4cfe469a501742a68f61acb8f1eb0b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be12c787-5d63-496b-91a2-8f273de49ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be12c787-5d63-496b-91a2-8f273de49ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c2617a-9ae6-4348-aaf1-95bfbc4f7613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c2617a-9ae6-4348-aaf1-95bfbc4f7613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ce2a07-1234-4f10-866a-68443e9b5b5b', 'volume_name': 'volume-76ce2a07-1234-4f10-866a-68443e9b5b5b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38591e9-18e2-4cf3-9675-78d198e1f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38591e9-18e2-4cf3-9675-78d198e1f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677cfaf6-4098-47c5-bdcf-3ee19473300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Volume 76ce2a07-1234-4f10-866a-68443e9b5b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ce2a07-1234-4f10-866a-68443e9b5b5b', 'volume_size': 1} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1429638228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ce2a07-1234-4f10-866a-68443e9b5b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f7a4766e0f439899516bb6f35abc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:36Z,use_quota=True,user_id='4cfe469a501742a68f61acb8f1eb0b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Creating volume 76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:27:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b 1073741824 Sep 23 00:27:36 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b 1073741824" returned: 0 in 0.797s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:27:37 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677cfaf6-4098-47c5-bdcf-3ee19473300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ce2a07-1234-4f10-866a-68443e9b5b5b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb51190-f8a6-40f5-a163-a9f348327d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Volume volume-76ce2a07-1234-4f10-866a-68443e9b5b5b (76ce2a07-1234-4f10-866a-68443e9b5b5b): created successfully Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb51190-f8a6-40f5-a163-a9f348327d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Flow 'volume_create_manager' (214d4e51-32e2-46eb-b8cd-70c9a4d09e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b4d54e09-30ed-4073-8fb4-61572dba50bc tempest-TestStampPattern-667061659 None] Created volume successfully. Sep 23 00:27:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=32,cinder:INSERT=10,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:47 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=35,cinder:SELECT=29,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:49 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:49 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:50 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Flow 'volume_create_manager' (0e13adf5-86d7-4c9d-9b93-9833c2e3a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ceb591-9c7d-4220-992a-e5c0cdb9db3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ceb591-9c7d-4220-992a-e5c0cdb9db3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1163757238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5961a4-edb6-495a-b5de-d61e2a516e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85e9b1b155543438512e91b1615d2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:51Z,use_quota=True,user_id='b87ceb947a22491085037c103c8f964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256cb5d-0d97-492f-b1d5-bb7ea8fdb180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256cb5d-0d97-492f-b1d5-bb7ea8fdb180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe296b4-afd7-47d3-b7cd-f597e88727b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe296b4-afd7-47d3-b7cd-f597e88727b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5961a4-edb6-495a-b5de-d61e2a516e03', 'volume_name': 'volume-0c5961a4-edb6-495a-b5de-d61e2a516e03', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e02b5c-dbb1-4b3b-ac3e-7a158efe9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e02b5c-dbb1-4b3b-ac3e-7a158efe9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2829bc-f779-4b21-8431-2c12b98a638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume 0c5961a4-edb6-495a-b5de-d61e2a516e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5961a4-edb6-495a-b5de-d61e2a516e03', 'volume_size': 1} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1163757238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5961a4-edb6-495a-b5de-d61e2a516e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85e9b1b155543438512e91b1615d2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:51Z,use_quota=True,user_id='b87ceb947a22491085037c103c8f964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Creating volume 0c5961a4-edb6-495a-b5de-d61e2a516e03 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:51 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:51 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 1073741824 Sep 23 00:27:51 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:51 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 1073741824" returned: 0 in 0.785s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:51 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 Sep 23 00:27:51 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2829bc-f779-4b21-8431-2c12b98a638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5961a4-edb6-495a-b5de-d61e2a516e03', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b596f3-46a3-498f-9340-1a0cc4d65b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 (0c5961a4-edb6-495a-b5de-d61e2a516e03): created successfully Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b596f3-46a3-498f-9340-1a0cc4d65b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Flow 'volume_create_manager' (0e13adf5-86d7-4c9d-9b93-9833c2e3a490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-139a9994-9c6c-4e2b-843c-bd4d018a9266 tempest-VolumeQuotasAdminTestJSON-841576678 None] Created volume successfully. Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "cinder-0c5961a4-edb6-495a-b5de-d61e2a516e03-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "cinder-0c5961a4-edb6-495a-b5de-d61e2a516e03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "cinder-quobyte-0c5961a4-edb6-495a-b5de-d61e2a516e03" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "cinder-quobyte-0c5961a4-edb6-495a-b5de-d61e2a516e03" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e4b5e6-5d6a-4bb9-821f-8e9aeeaf74f2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:53 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 Sep 23 00:27:53 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:53 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03" returned: 0 in 0.617s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:54 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03 Sep 23 00:27:54 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:54 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0c5961a4-edb6-495a-b5de-d61e2a516e03" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "cinder-quobyte-0c5961a4-edb6-495a-b5de-d61e2a516e03" released by "delete_volume" :: held 1.101s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Created reservations ['f7e593c3-5ae9-41ab-bf93-99530d99ea23', 'd2eecc8a-1909-49ad-a50a-dc244521d120', '6dbd940a-bc7d-47c5-b001-54bb132804b8', '89fdd3ef-ea90-4fb3-b464-7a19832715b7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:54 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:27:54 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:55 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Deleted volume successfully. Sep 23 00:27:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de41e2bd-437e-4455-8ac4-a4fae567cf42 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "cinder-0c5961a4-edb6-495a-b5de-d61e2a516e03-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Flow 'volume_create_manager' (d0e53657-8f1e-46df-9859-19b76cee6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169421eb-0dcf-4cde-b6ff-5bfc55e346ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169421eb-0dcf-4cde-b6ff-5bfc55e346ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1262132874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dc19df-ebed-4e66-b7b6-b60e00f64940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85e9b1b155543438512e91b1615d2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:56Z,use_quota=True,user_id='b87ceb947a22491085037c103c8f964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef5aa90-fa91-4b2b-a56e-9a4ec443c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef5aa90-fa91-4b2b-a56e-9a4ec443c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca80c7b8-08bd-48d1-84a1-e4e321351d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca80c7b8-08bd-48d1-84a1-e4e321351d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dc19df-ebed-4e66-b7b6-b60e00f64940', 'volume_name': 'volume-23dc19df-ebed-4e66-b7b6-b60e00f64940', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e275e4d-00b8-419c-bb3f-b03978cbce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e275e4d-00b8-419c-bb3f-b03978cbce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402958f4-1813-4b52-b335-ac73be621f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:56 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume 23dc19df-ebed-4e66-b7b6-b60e00f64940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dc19df-ebed-4e66-b7b6-b60e00f64940', 'volume_size': 1} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1262132874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dc19df-ebed-4e66-b7b6-b60e00f64940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85e9b1b155543438512e91b1615d2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:56Z,use_quota=True,user_id='b87ceb947a22491085037c103c8f964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Creating volume 23dc19df-ebed-4e66-b7b6-b60e00f64940 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:56 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:27:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:56 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 1073741824 Sep 23 00:27:56 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:57 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 1073741824" returned: 0 in 0.546s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:57 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 Sep 23 00:27:57 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:57 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402958f4-1813-4b52-b335-ac73be621f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dc19df-ebed-4e66-b7b6-b60e00f64940', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34957bfd-0ec5-430b-8c61-2eba51a529e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Volume volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 (23dc19df-ebed-4e66-b7b6-b60e00f64940): created successfully Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34957bfd-0ec5-430b-8c61-2eba51a529e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Flow 'volume_create_manager' (d0e53657-8f1e-46df-9859-19b76cee6aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7481cda3-35d7-4c7f-a9d0-7b1798c18840 tempest-VolumeQuotasAdminTestJSON-841576678 None] Created volume successfully. Sep 23 00:27:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-33877b98-ea59-4250-98bb-239d1acd5768 tempest-VolumeQuotasAdminTestJSON-922860275 None] Transfer volume completed successfully. Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Acquiring lock "cinder-23dc19df-ebed-4e66-b7b6-b60e00f64940-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "cinder-23dc19df-ebed-4e66-b7b6-b60e00f64940-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Acquiring lock "cinder-quobyte-23dc19df-ebed-4e66-b7b6-b60e00f64940" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "cinder-quobyte-23dc19df-ebed-4e66-b7b6-b60e00f64940" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[551399f1-801e-409f-8144-c74e1a76491e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:00 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 Sep 23 00:28:00 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940 Sep 23 00:28:01 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-23dc19df-ebed-4e66-b7b6-b60e00f64940" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "cinder-quobyte-23dc19df-ebed-4e66-b7b6-b60e00f64940" released by "delete_volume" :: held 1.088s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Created reservations ['9f8fe0c8-d187-44e8-b894-42afb4cefcf2', '97e43256-380e-404d-9a6f-168d7920cbea', 'f01b77da-966e-4f04-a013-fb0e94218528', '34bd317b-464a-416c-95d6-3d7c31dbec1b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:28:02 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Deleted volume successfully. Sep 23 00:28:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-60113f11-ae34-4b0f-9fc7-343b951a117b tempest-VolumeQuotasAdminTestJSON-1226977188 None] Lock "cinder-23dc19df-ebed-4e66-b7b6-b60e00f64940-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8774048e-2f55-452a-bfda-d7232f2d260e req-38539d12-da97-4d95-aad7-4e2eb1a4df88 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8774048e-2f55-452a-bfda-d7232f2d260e req-38539d12-da97-4d95-aad7-4e2eb1a4df88 tempest-TestStampPattern-667061659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-8774048e-2f55-452a-bfda-d7232f2d260e req-38539d12-da97-4d95-aad7-4e2eb1a4df88 tempest-TestStampPattern-667061659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-8774048e-2f55-452a-bfda-d7232f2d260e req-38539d12-da97-4d95-aad7-4e2eb1a4df88 tempest-TestStampPattern-667061659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-76ce2a07-1234-4f10-866a-68443e9b5b5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53103813-6d91-4068-9822-e8f17c8cd3a2', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:28:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-8774048e-2f55-452a-bfda-d7232f2d260e req-38539d12-da97-4d95-aad7-4e2eb1a4df88 tempest-TestStampPattern-667061659 None] attachment_update completed successfully. Sep 23 00:28:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-10b224bc-2fe9-4acc-9afb-46153576590e req-9384f8f8-1e50-46c1-92e7-3394517efbda tempest-TestStampPattern-667061659 None] Terminate volume connection completed successfully. Sep 23 00:28:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-10b224bc-2fe9-4acc-9afb-46153576590e req-9384f8f8-1e50-46c1-92e7-3394517efbda tempest-TestStampPattern-667061659 None] Deleting attachment 53103813-6d91-4068-9822-e8f17c8cd3a2. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Creating offline snapshot f671b670-6823-4a3a-b9d7-f6a5172b635d of volume 76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa079a8d-d8fe-42ce-80db-4bde5321dacb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:28:23 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:23 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d 1G Sep 23 00:28:23 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:24 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d 1G" returned: 0 in 0.682s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce2a07-1234-4f10-866a-68443e9b5b5b -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce2a07-1234-4f10-866a-68443e9b5b5b -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:28:24 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:24 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ce2a07-1234-4f10-866a-68443e9b5b5b -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:24 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d is being set with open permissions: ugo+rw Sep 23 00:28:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:28:24 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Flow 'volume_create_manager' (cdb6586f-d434-48b8-982f-480052dd40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86f2367-16f7-4a5e-80be-082656f25f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86f2367-16f7-4a5e-80be-082656f25f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-562530548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913c8a24-fb86-49e2-8d31-1fe97e5aee9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496436c06411442487944ecb27ff2417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:25Z,use_quota=True,user_id='b36431739de54617b66866603c1a6c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5d1033-2524-42e2-b32f-ae1cc75aab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5d1033-2524-42e2-b32f-ae1cc75aab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192cc3df-dc64-4cf6-9727-6016d59e1e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192cc3df-dc64-4cf6-9727-6016d59e1e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '913c8a24-fb86-49e2-8d31-1fe97e5aee9a', 'volume_name': 'volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eef49c-30bd-4af2-b812-b2895ed7af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eef49c-30bd-4af2-b812-b2895ed7af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba50a46-fde9-409c-9943-46e7638ee284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Volume 913c8a24-fb86-49e2-8d31-1fe97e5aee9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a', 'volume_size': 1} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info Sep 23 00:28:25 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info is being set with open permissions: ugo+rw Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info Sep 23 00:28:25 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.info" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-562530548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913c8a24-fb86-49e2-8d31-1fe97e5aee9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496436c06411442487944ecb27ff2417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:25Z,use_quota=True,user_id='b36431739de54617b66866603c1a6c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Creating volume 913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a 1073741824 Sep 23 00:28:26 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-39b53561-7ace-46a0-a3df-66a20fd6ccb3 tempest-TestStampPattern-667061659 None] Create snapshot completed successfully Sep 23 00:28:26 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a 1073741824" returned: 0 in 0.726s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a Sep 23 00:28:26 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:27 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba50a46-fde9-409c-9943-46e7638ee284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3054cc-edcb-4002-9b4b-5f9d1d7d5109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Volume volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a (913c8a24-fb86-49e2-8d31-1fe97e5aee9a): created successfully Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3054cc-edcb-4002-9b4b-5f9d1d7d5109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Flow 'volume_create_manager' (cdb6586f-d434-48b8-982f-480052dd40f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0418aec0-3056-40e2-aeee-0a9b67da373b tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Created volume successfully. Sep 23 00:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Creating offline snapshot b182cc86-5761-495f-a5d3-6d16f32a3c95 of volume 913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1772cd74-5f67-4006-86e7-494709a8b9f4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a Sep 23 00:28:29 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" returned: 0 in 0.616s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 1G Sep 23 00:28:29 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 1G" returned: 0 in 0.684s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 Sep 23 00:28:30 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95" returned: 0 in 0.518s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 is being set with open permissions: ugo+rw Sep 23 00:28:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 Sep 23 00:28:30 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info Sep 23 00:28:31 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info" returned: 0 in 0.732s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info is being set with open permissions: ugo+rw Sep 23 00:28:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:32 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info Sep 23 00:28:32 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.info" returned: 0 in 0.837s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-551305bc-1d11-43da-ada7-95c0034bb45a tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Create snapshot completed successfully Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "cinder-b182cc86-5761-495f-a5d3-6d16f32a3c95-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-b182cc86-5761-495f-a5d3-6d16f32a3c95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "cinder-quobyte-b182cc86-5761-495f-a5d3-6d16f32a3c95" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-b182cc86-5761-495f-a5d3-6d16f32a3c95" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Deleting offline snapshot b182cc86-5761-495f-a5d3-6d16f32a3c95 of volume 913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] snapshot_file for this snap is: volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa62762-eb90-4104-90c7-654d82e1beb8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 Sep 23 00:28:34 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e066bdc6-06e5-4fed-8b48-896893e79cc4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a Sep 23 00:28:35 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" returned: 0 in 0.710s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 Sep 23 00:28:35 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95" returned: 0 in 0.861s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95 Sep 23 00:28:36 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a.b182cc86-5761-495f-a5d3-6d16f32a3c95" returned: 0 in 0.439s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-b182cc86-5761-495f-a5d3-6d16f32a3c95" released by "_delete_snapshot" :: held 2.742s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" released by "delete_snapshot" :: held 2.815s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Created reservations ['ecd0070c-7ffb-43ff-8524-5297bc088fd3', '6a4ccfa3-e925-4a3d-a9ed-02a5fc5c3af2', '1da786bf-6859-4dd1-877b-4440880811db', '4f50b529-09b0-4d24-8764-8c112776e832'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Delete snapshot completed successfully. Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-80650d0b-d4c5-435b-84f6-a47cf2a0fd49 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-b182cc86-5761-495f-a5d3-6d16f32a3c95-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "cinder-913c8a24-fb86-49e2-8d31-1fe97e5aee9a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-913c8a24-fb86-49e2-8d31-1fe97e5aee9a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d9ba2-065a-4020-9ebe-045e4e4b8174]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a Sep 23 00:28:38 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" returned: 0 in 0.839s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a Sep 23 00:28:39 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Flow 'volume_create_manager' (003285eb-39da-445e-9862-a8229be9610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa87006-a7eb-4e5b-9add-9e4565702253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa87006-a7eb-4e5b-9add-9e4565702253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-729604782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788560f3-acd3-4bfe-8a63-b2b50542bae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f7a4766e0f439899516bb6f35abc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f671b670-6823-4a3a-b9d7-f6a5172b635d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:39Z,use_quota=True,user_id='4cfe469a501742a68f61acb8f1eb0b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6af97-f1aa-46eb-ac2c-ffacd4825a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba6af97-f1aa-46eb-ac2c-ffacd4825a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cb335f-0303-4aae-91bc-009d95e7802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cb335f-0303-4aae-91bc-009d95e7802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '788560f3-acd3-4bfe-8a63-b2b50542bae5', 'volume_name': 'volume-788560f3-acd3-4bfe-8a63-b2b50542bae5', 'volume_size': 1, 'snapshot_id': 'f671b670-6823-4a3a-b9d7-f6a5172b635d'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b983f3bb-6731-467a-903c-b7fee0bd5394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b983f3bb-6731-467a-903c-b7fee0bd5394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd475ff2-431c-4dbf-a225-c3aebb49fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Volume 788560f3-acd3-4bfe-8a63-b2b50542bae5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-788560f3-acd3-4bfe-8a63-b2b50542bae5', 'volume_size': 1, 'snapshot_id': 'f671b670-6823-4a3a-b9d7-f6a5172b635d'} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" returned: 0 in 0.557s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d-788560f3-acd3-4bfe-8a63-b2b50542bae5" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-quobyte-913c8a24-fb86-49e2-8d31-1fe97e5aee9a" released by "delete_volume" :: held 1.525s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d-788560f3-acd3-4bfe-8a63-b2b50542bae5" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Creating volume 788560f3-acd3-4bfe-8a63-b2b50542bae5 from snapshot f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] snapshot: f671b670-6823-4a3a-b9d7-f6a5172b635d, volume: 788560f3-acd3-4bfe-8a63-b2b50542bae5, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94f570-6c98-4106-9d7e-2409c7cf12cd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Created reservations ['e9eeef69-4236-4b97-84f6-9ba510641059', 'e497ca46-2cdc-4fb5-a59e-1549c2f8ad57', 'd4f13a52-7bfa-4c42-bcb3-ca20b5ae7c7a', 'e240a263-d31b-49a6-b746-0e899c9b458c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:28:39 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:28:40 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.486s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Deleted volume successfully. Sep 23 00:28:40 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.804s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ce2a07-1234-4f10-866a-68443e9b5b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-97f445db-c1d3-4bf1-9004-4e7dc1ea7723 tempest-VolumeSnapshotQuotasNegativeTestJSON-124886627 None] Lock "cinder-913c8a24-fb86-49e2-8d31-1fe97e5aee9a-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb891a5-1f0f-445c-8003-3e0cf75cac04]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:28:40 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.693s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:28:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:28:41 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:28:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 Sep 23 00:28:41 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:49 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=45,cinder:INSERT=12,cinder:UPDATE=43,cinder:DELETE=5 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:50 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:28:50 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=45,cinder:SELECT=43,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:50 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.861s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:53 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5" returned: 0 in 12.145s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b, size 1024.00 MB, duration 12.15 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:53 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Converted 1024.00 MB image at 84.29 MB/s Sep 23 00:28:53 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 Sep 23 00:28:53 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 is being set with open permissions: ugo+rw Sep 23 00:28:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:54 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" released by "_copy_volume_from_snapshot" :: held 14.337s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d-788560f3-acd3-4bfe-8a63-b2b50542bae5" released by "_create_volume_from_snapshot" :: held 14.486s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.535s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd475ff2-431c-4dbf-a225-c3aebb49fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788560f3-acd3-4bfe-8a63-b2b50542bae5', 'volume_size': 1, 'snapshot_id': 'f671b670-6823-4a3a-b9d7-f6a5172b635d'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c00b43-a1f8-4282-bb0d-637945ab09b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:54 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Volume volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 (788560f3-acd3-4bfe-8a63-b2b50542bae5): created successfully Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c00b43-a1f8-4282-bb0d-637945ab09b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:54 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Flow 'volume_create_manager' (003285eb-39da-445e-9862-a8229be9610b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0bd88b24-4d39-463b-8f28-1b86904b6084 tempest-TestStampPattern-667061659 None] Created volume successfully. Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Flow 'volume_create_manager' (64bfc795-2ff1-4501-a89a-f1a74c92176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1b2135-ea77-4aa2-b3c5-035707e8f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1b2135-ea77-4aa2-b3c5-035707e8f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1765995528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972ede8-b360-43a9-af55-05961c683ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d7e24ae45412a9bdf30abdf0ad69c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:00Z,use_quota=True,user_id='4c899e3eb9354508b163753ec08547cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee1987d-38cb-40ff-8b2b-4c9ed47d30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee1987d-38cb-40ff-8b2b-4c9ed47d30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b50856-3f00-45fa-a6ff-16ea610e79cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b50856-3f00-45fa-a6ff-16ea610e79cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b972ede8-b360-43a9-af55-05961c683ef7', 'volume_name': 'volume-b972ede8-b360-43a9-af55-05961c683ef7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106dc20c-6a6a-47cc-93aa-6d8df024e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106dc20c-6a6a-47cc-93aa-6d8df024e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a742a2-d2ab-41d5-9d86-20fa14be0016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Volume b972ede8-b360-43a9-af55-05961c683ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b972ede8-b360-43a9-af55-05961c683ef7', 'volume_size': 1} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1765995528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972ede8-b360-43a9-af55-05961c683ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d7e24ae45412a9bdf30abdf0ad69c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:00Z,use_quota=True,user_id='4c899e3eb9354508b163753ec08547cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Creating volume b972ede8-b360-43a9-af55-05961c683ef7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:59 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:28:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 1073741824 Sep 23 00:29:00 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:00 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 1073741824" returned: 0 in 0.795s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 Sep 23 00:29:00 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:01 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7" returned: 0 in 0.387s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a742a2-d2ab-41d5-9d86-20fa14be0016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b972ede8-b360-43a9-af55-05961c683ef7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a0e442-f2d1-484a-a5b8-5f83da0ef903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Volume volume-b972ede8-b360-43a9-af55-05961c683ef7 (b972ede8-b360-43a9-af55-05961c683ef7): created successfully Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a0e442-f2d1-484a-a5b8-5f83da0ef903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Flow 'volume_create_manager' (64bfc795-2ff1-4501-a89a-f1a74c92176f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-774d2477-ebc5-4a59-aaf0-3319462aeb02 tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Created volume successfully. Sep 23 00:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-56ea8f9e-854a-42f0-a1ad-1ffb53d54d40 req-36a82dc1-e67b-4311-90b4-2dc5d7bcf83b tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-56ea8f9e-854a-42f0-a1ad-1ffb53d54d40 req-36a82dc1-e67b-4311-90b4-2dc5d7bcf83b tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-56ea8f9e-854a-42f0-a1ad-1ffb53d54d40 req-36a82dc1-e67b-4311-90b4-2dc5d7bcf83b tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-56ea8f9e-854a-42f0-a1ad-1ffb53d54d40 req-36a82dc1-e67b-4311-90b4-2dc5d7bcf83b tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-b972ede8-b360-43a9-af55-05961c683ef7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f286c64-e295-4dca-850e-23af85fe6645', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-56ea8f9e-854a-42f0-a1ad-1ffb53d54d40 req-36a82dc1-e67b-4311-90b4-2dc5d7bcf83b tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] attachment_update completed successfully. Sep 23 00:29:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-05e2022c-6d8d-4b5e-a04f-e44ca6a1aeca req-0ff560b3-e518-408b-9fe9-b8f8be4384cb tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Terminate volume connection completed successfully. Sep 23 00:29:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-05e2022c-6d8d-4b5e-a04f-e44ca6a1aeca req-0ff560b3-e518-408b-9fe9-b8f8be4384cb tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Deleting attachment 8f286c64-e295-4dca-850e-23af85fe6645. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "cinder-b972ede8-b360-43a9-af55-05961c683ef7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "cinder-b972ede8-b360-43a9-af55-05961c683ef7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "cinder-quobyte-b972ede8-b360-43a9-af55-05961c683ef7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "cinder-quobyte-b972ede8-b360-43a9-af55-05961c683ef7" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d9962-0b7e-4cfb-9199-3946c6f165e5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 Sep 23 00:29:09 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:09 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7 Sep 23 00:29:09 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:09 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b972ede8-b360-43a9-af55-05961c683ef7" returned: 0 in 0.445s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "cinder-quobyte-b972ede8-b360-43a9-af55-05961c683ef7" released by "delete_volume" :: held 1.090s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Created reservations ['aafe5843-a743-4462-b7b0-982b6c097bd6', '13cc2b28-0f02-4368-8ed2-4be08746d64b', '0bea2c17-8ac3-4f32-a695-7a28d0a34031', '886d35fe-3de9-4632-8e81-b41a08a2ddb1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:29:10 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Deleted volume successfully. Sep 23 00:29:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-faca4d46-2d02-41b7-8ae7-231c0029c37d tempest-TestServerVolumeAttachScenarioOldVersion-536042388 None] Lock "cinder-b972ede8-b360-43a9-af55-05961c683ef7-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Flow 'volume_create_manager' (35d5bfb4-e025-42d3-b71c-4ecc39030652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e6f56e-eb6a-47c4-98f5-c29ea466ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e6f56e-eb6a-47c4-98f5-c29ea466ee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1104192686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068d1242-f775-4c6f-846c-c1da8f96989c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c49d62c494c42878b2701df7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:19Z,use_quota=True,user_id='2d453d5c6dd84e268a7afd05ce6ff4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb4958f-e63d-4c91-9762-2476a5cccb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb4958f-e63d-4c91-9762-2476a5cccb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d170c69-a771-4f11-9391-7621df024318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d170c69-a771-4f11-9391-7621df024318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068d1242-f775-4c6f-846c-c1da8f96989c', 'volume_name': 'volume-068d1242-f775-4c6f-846c-c1da8f96989c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799877b-fde7-4fab-9f3b-63d662e15398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799877b-fde7-4fab-9f3b-63d662e15398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf2ff0c-7641-4d3a-80ee-6632d609fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:19 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Volume 068d1242-f775-4c6f-846c-c1da8f96989c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068d1242-f775-4c6f-846c-c1da8f96989c', 'volume_size': 1} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1104192686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068d1242-f775-4c6f-846c-c1da8f96989c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c49d62c494c42878b2701df7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:19Z,use_quota=True,user_id='2d453d5c6dd84e268a7afd05ce6ff4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Creating volume 068d1242-f775-4c6f-846c-c1da8f96989c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:19 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c 1073741824 Sep 23 00:29:19 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c 1073741824" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c Sep 23 00:29:19 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf2ff0c-7641-4d3a-80ee-6632d609fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068d1242-f775-4c6f-846c-c1da8f96989c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9432e16-8058-4a72-82c4-08050dde5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:20 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Volume volume-068d1242-f775-4c6f-846c-c1da8f96989c (068d1242-f775-4c6f-846c-c1da8f96989c): created successfully Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9432e16-8058-4a72-82c4-08050dde5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:20 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Flow 'volume_create_manager' (35d5bfb4-e025-42d3-b71c-4ecc39030652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-731cda7c-fe02-4cd6-b955-b211c461be6a tempest-VolumesTransfersV355Test-73687380 None] Created volume successfully. Sep 23 00:29:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4b99b488-0bf2-4ffa-8ef0-9f9ef86d46da tempest-VolumesTransfersV355Test-1494617087 None] Transfer volume completed successfully. Sep 23 00:29:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "cinder-068d1242-f775-4c6f-846c-c1da8f96989c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-068d1242-f775-4c6f-846c-c1da8f96989c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "cinder-quobyte-068d1242-f775-4c6f-846c-c1da8f96989c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-quobyte-068d1242-f775-4c6f-846c-c1da8f96989c" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b35ea6-1801-43d0-a9b9-9eaf1529c51e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c Sep 23 00:29:23 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c" returned: 0 in 0.623s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c Sep 23 00:29:23 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-068d1242-f775-4c6f-846c-c1da8f96989c" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-quobyte-068d1242-f775-4c6f-846c-c1da8f96989c" released by "delete_volume" :: held 1.067s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Created reservations ['45d75237-79de-44e1-9419-f1da10959d3c', 'c2067cca-9ab9-4411-9abf-bf7d2f9e9b5f', '543b2276-5097-4ffd-9bad-7d2ecbfb71df', '1f8071d7-01bf-4e97-8c34-e1aeb832667d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:29:24 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.341s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Deleted volume successfully. Sep 23 00:29:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-f66c13a3-4c20-4aa8-8623-5b28af8fbe04 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-068d1242-f775-4c6f-846c-c1da8f96989c-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:25 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Flow 'volume_create_manager' (bdc6b628-2ea9-47ca-a89f-96cf90a69da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce17470-b441-4204-baf3-59509b7b1e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce17470-b441-4204-baf3-59509b7b1e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-143599962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3935c313-b28b-4f8b-b061-f9ffeac1ba03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c49d62c494c42878b2701df7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:26Z,use_quota=True,user_id='2d453d5c6dd84e268a7afd05ce6ff4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2798e8-9fba-4247-b011-e73290505caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2798e8-9fba-4247-b011-e73290505caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25688ea4-e46d-438e-96f1-230921dcea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25688ea4-e46d-438e-96f1-230921dcea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3935c313-b28b-4f8b-b061-f9ffeac1ba03', 'volume_name': 'volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc84330e-d699-4fe7-840c-63568b319763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc84330e-d699-4fe7-840c-63568b319763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c23e5b-522b-4a28-8147-6f78d9585fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Volume 3935c313-b28b-4f8b-b061-f9ffeac1ba03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03', 'volume_size': 1} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-143599962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3935c313-b28b-4f8b-b061-f9ffeac1ba03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c49d62c494c42878b2701df7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:26Z,use_quota=True,user_id='2d453d5c6dd84e268a7afd05ce6ff4f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Creating volume 3935c313-b28b-4f8b-b061-f9ffeac1ba03 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:26 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 1073741824 Sep 23 00:29:26 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 1073741824" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 Sep 23 00:29:26 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c23e5b-522b-4a28-8147-6f78d9585fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc79a7c-46f2-4ba5-bf27-b7bc6458fb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Volume volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 (3935c313-b28b-4f8b-b061-f9ffeac1ba03): created successfully Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc79a7c-46f2-4ba5-bf27-b7bc6458fb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Flow 'volume_create_manager' (bdc6b628-2ea9-47ca-a89f-96cf90a69da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-391ba3c4-b9da-4eb8-837d-c5ae24a4eab1 tempest-VolumesTransfersV355Test-73687380 None] Created volume successfully. Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "cinder-3935c313-b28b-4f8b-b061-f9ffeac1ba03-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-3935c313-b28b-4f8b-b061-f9ffeac1ba03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "cinder-quobyte-3935c313-b28b-4f8b-b061-f9ffeac1ba03" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-quobyte-3935c313-b28b-4f8b-b061-f9ffeac1ba03" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ed5351-87b9-49c7-b131-cd863e103bb2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 Sep 23 00:29:28 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03 Sep 23 00:29:29 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3935c313-b28b-4f8b-b061-f9ffeac1ba03" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-quobyte-3935c313-b28b-4f8b-b061-f9ffeac1ba03" released by "delete_volume" :: held 0.796s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Created reservations ['6a6c7ec2-a660-47f7-a364-5cac82a62916', 'f9350889-34fd-4e5d-9aa0-44e30439eb64', '9ae90f88-70eb-48f8-8ee1-e5e8b854cc81', '62d42edd-6113-41d1-9ec5-d32e9c269ba4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:29:29 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.368s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Deleted volume successfully. Sep 23 00:29:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a37b2498-4527-4cb6-9702-882449a21116 tempest-VolumesTransfersV355Test-1845881468 None] Lock "cinder-3935c313-b28b-4f8b-b061-f9ffeac1ba03-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Flow 'volume_create_manager' (cba6ba3b-37a3-42ac-890e-dc7c7484376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9198f04-4592-4654-9f30-050d28a851c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9198f04-4592-4654-9f30-050d28a851c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1283160274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eca989-692c-4060-9baa-83fbff3376cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a811dc9956d4a84841f0310ab572ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:38Z,use_quota=True,user_id='085c5460d5434b888f949fb7b79c3c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296a08d7-71df-4e17-a4ac-ca94bb77bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296a08d7-71df-4e17-a4ac-ca94bb77bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771204ec-cdbe-4edb-b564-da846607be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771204ec-cdbe-4edb-b564-da846607be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21eca989-692c-4060-9baa-83fbff3376cb', 'volume_name': 'volume-21eca989-692c-4060-9baa-83fbff3376cb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d95fa45-dd28-4eee-aa7a-a19f962f0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d95fa45-dd28-4eee-aa7a-a19f962f0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eab7de5-0cce-4d09-9ff5-3c497eb2f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Volume 21eca989-692c-4060-9baa-83fbff3376cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21eca989-692c-4060-9baa-83fbff3376cb', 'volume_size': 1} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1283160274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eca989-692c-4060-9baa-83fbff3376cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a811dc9956d4a84841f0310ab572ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:38Z,use_quota=True,user_id='085c5460d5434b888f949fb7b79c3c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Creating volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb 1073741824 Sep 23 00:29:38 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:38 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb 1073741824" returned: 0 in 0.737s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b58c9386-1bd8-49b4-9b37-a3f5ec6f661b req-edcbf8a3-c4e8-4e05-8380-33c48a44b67f tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb Sep 23 00:29:39 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b58c9386-1bd8-49b4-9b37-a3f5ec6f661b req-edcbf8a3-c4e8-4e05-8380-33c48a44b67f tempest-TestStampPattern-667061659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.414s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eab7de5-0cce-4d09-9ff5-3c497eb2f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21eca989-692c-4060-9baa-83fbff3376cb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1088a5-9007-4767-b184-72f47654d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-b58c9386-1bd8-49b4-9b37-a3f5ec6f661b req-edcbf8a3-c4e8-4e05-8380-33c48a44b67f tempest-TestStampPattern-667061659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Volume volume-21eca989-692c-4060-9baa-83fbff3376cb (21eca989-692c-4060-9baa-83fbff3376cb): created successfully Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1088a5-9007-4767-b184-72f47654d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Flow 'volume_create_manager' (cba6ba3b-37a3-42ac-890e-dc7c7484376a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5f193255-da8e-44f9-a8b3-5c099a2a5dd3 tempest-VolumesSnapshotListTestJSON-486676708 None] Created volume successfully. Sep 23 00:29:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-b58c9386-1bd8-49b4-9b37-a3f5ec6f661b req-edcbf8a3-c4e8-4e05-8380-33c48a44b67f tempest-TestStampPattern-667061659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-788560f3-acd3-4bfe-8a63-b2b50542bae5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '306bdba4-f4a9-4aa3-ae71-bfb3d05bcd1a', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-b58c9386-1bd8-49b4-9b37-a3f5ec6f661b req-edcbf8a3-c4e8-4e05-8380-33c48a44b67f tempest-TestStampPattern-667061659 None] attachment_update completed successfully. Sep 23 00:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Creating offline snapshot 175bf36e-fd85-4d85-bf92-21dcff293873 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0de13-a700-434c-86c8-090729de9bcb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:40 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb Sep 23 00:29:40 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:41 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb" returned: 0 in 0.583s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:41 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 1G Sep 23 00:29:41 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:41 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 1G" returned: 0 in 0.687s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:41 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:29:41 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:42 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.590s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 is being set with open permissions: ugo+rw Sep 23 00:29:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:42 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:29:42 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:43 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:43 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info Sep 23 00:29:43 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:43 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info" returned: 0 in 0.475s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:43 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info is being set with open permissions: ugo+rw Sep 23 00:29:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:43 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info Sep 23 00:29:43 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-4478d639-2c43-45fe-bed8-4267c9355f3a req-92554d1f-6cbb-4826-82ee-9a61f0fc244d tempest-TestStampPattern-667061659 None] Terminate volume connection completed successfully. Sep 23 00:29:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-4478d639-2c43-45fe-bed8-4267c9355f3a req-92554d1f-6cbb-4826-82ee-9a61f0fc244d tempest-TestStampPattern-667061659 None] Deleting attachment 306bdba4-f4a9-4aa3-ae71-bfb3d05bcd1a. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:44 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.info" returned: 0 in 0.446s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.499s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-831cb620-14ec-456b-bdf1-0181716f0021 tempest-VolumesSnapshotListTestJSON-486676708 None] Create snapshot completed successfully Sep 23 00:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Creating offline snapshot 3d64cdd4-9aed-4b3d-a3ec-e63890006247 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b85a36-91ba-4f56-a2c4-68ebc497b2b3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:29:45 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.766s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 1G Sep 23 00:29:46 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 1G" returned: 0 in 0.941s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:47 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 is being set with open permissions: ugo+rw Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:47 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:47 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d3df2513-e8b2-47f8-86dc-ea41213da7f3 tempest-VolumesSnapshotListTestJSON-486676708 None] Create snapshot completed successfully Sep 23 00:29:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Creating offline snapshot 2d94efd4-1e2f-4c43-860a-bb603e2409e9 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d708a-44d1-4283-bf74-84220fdfee09]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:49 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.553s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 1G Sep 23 00:29:49 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-788560f3-acd3-4bfe-8a63-b2b50542bae5-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "cinder-788560f3-acd3-4bfe-8a63-b2b50542bae5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b3970-8fd1-48ce-9b9e-457ef694d39b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 Sep 23 00:29:49 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:29:49 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 1G" returned: 0 in 0.718s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 Sep 23 00:29:50 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:50 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5" returned: 0 in 0.656s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5 Sep 23 00:29:50 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9" returned: 0 in 0.440s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 is being set with open permissions: ugo+rw Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 Sep 23 00:29:50 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-788560f3-acd3-4bfe-8a63-b2b50542bae5" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-788560f3-acd3-4bfe-8a63-b2b50542bae5" released by "delete_volume" :: held 1.077s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=53,cinder:INSERT=10,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=50,cinder:SELECT=45,cinder:INSERT=8,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:50 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Created reservations ['f9fe5d5f-47e2-4f2d-b3eb-5b2921c09ac7', 'aa8ab738-c0f0-4841-9594-1af63f866358', '4ff8dbf1-3e1b-4cf3-98f4-4b8f6ba9d87d', '36c7f599-e6bc-4abd-b9a8-697fab3b2f35'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-865f3685-5ea5-4f15-9b31-c3fde70e2130 tempest-VolumesSnapshotListTestJSON-486676708 None] Create snapshot completed successfully Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:29:51 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.289s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Deleted volume successfully. Sep 23 00:29:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1314c6ab-49f3-4955-b98c-9eb39a3ad1ae tempest-TestStampPattern-667061659 None] Lock "cinder-788560f3-acd3-4bfe-8a63-b2b50542bae5-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-f671b670-6823-4a3a-b9d7-f6a5172b635d-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-f671b670-6823-4a3a-b9d7-f6a5172b635d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Deleting offline snapshot f671b670-6823-4a3a-b9d7-f6a5172b635d of volume 76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] snapshot_file for this snap is: volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[409dd226-8a72-4db4-b186-93c98dc11501]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:52 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:29:52 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ce2a07-1234-4f10-866a-68443e9b5b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f4a45-5682-451c-9d5d-af51d4a38d05]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:29:53 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-2d94efd4-1e2f-4c43-860a-bb603e2409e9-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-2d94efd4-1e2f-4c43-860a-bb603e2409e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-2d94efd4-1e2f-4c43-860a-bb603e2409e9" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-2d94efd4-1e2f-4c43-860a-bb603e2409e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Deleting offline snapshot 2d94efd4-1e2f-4c43-860a-bb603e2409e9 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] snapshot_file for this snap is: volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b58d76-b8bb-43f1-ad4c-f9da78f6895f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.718s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:29:53 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 Sep 23 00:29:53 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f903bec-4bbd-4bfe-9903-1e0af313f698]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.548s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d Sep 23 00:29:54 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:54 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b.f671b670-6823-4a3a-b9d7-f6a5172b635d" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-f671b670-6823-4a3a-b9d7-f6a5172b635d" released by "_delete_snapshot" :: held 2.388s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" released by "delete_snapshot" :: held 2.420s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:54 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 Sep 23 00:29:54 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Created reservations ['f643851f-9e81-4da9-9f38-83d28b157c67', '624e23fd-fb49-4ac9-9b71-f7112ef104f1', 'b9ca3d68-7747-4767-b5b1-d3395646e741', '8abe3c1e-e419-4829-b0c1-38614cef6d77'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:54 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Delete snapshot completed successfully. Sep 23 00:29:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9d77f95e-1364-4e3b-acad-3684ab3debfa tempest-TestStampPattern-667061659 None] Lock "cinder-f671b670-6823-4a3a-b9d7-f6a5172b635d-delete_snapshot" released by "delete_snapshot" :: held 2.629s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:55 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9" returned: 0 in 0.525s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9 Sep 23 00:29:55 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.2d94efd4-1e2f-4c43-860a-bb603e2409e9" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-2d94efd4-1e2f-4c43-860a-bb603e2409e9" released by "_delete_snapshot" :: held 2.119s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" released by "delete_snapshot" :: held 2.150s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Created reservations ['25f8dc99-e418-43e7-9e4c-94515cfae3b7', 'a95e626c-e156-4fe3-9ab8-257b8b9c7a27', 'bb59953c-2cf7-4820-a906-b700bb3cf538', '48b85103-889c-4db4-908f-582cfd22d4d6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Delete snapshot completed successfully. Sep 23 00:29:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6228f956-9eac-4b12-afb5-7d768c3c8172 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-2d94efd4-1e2f-4c43-860a-bb603e2409e9-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-3d64cdd4-9aed-4b3d-a3ec-e63890006247-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-3d64cdd4-9aed-4b3d-a3ec-e63890006247-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-3d64cdd4-9aed-4b3d-a3ec-e63890006247" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-3d64cdd4-9aed-4b3d-a3ec-e63890006247" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Deleting offline snapshot 3d64cdd4-9aed-4b3d-a3ec-e63890006247 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] snapshot_file for this snap is: volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9215b1-944a-4194-8e86-a230c79ecea7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:57 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:57 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.657s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef3a3fa-c392-4a04-ad03-91f38498cece]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:29:57 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:58 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:58 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:58 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:58 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.633s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:58 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247 Sep 23 00:29:59 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.3d64cdd4-9aed-4b3d-a3ec-e63890006247" returned: 0 in 0.358s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-3d64cdd4-9aed-4b3d-a3ec-e63890006247" released by "_delete_snapshot" :: held 2.379s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" released by "delete_snapshot" :: held 2.446s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Created reservations ['c0e8b209-086a-4a55-93ea-edd86f8748c9', 'b9b7b93e-2afc-4612-ac17-2b952036766c', '3696200d-ebda-4729-83cd-0d06dbab5af7', '0103f16d-b343-41f4-bf60-310b5cc965a0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Delete snapshot completed successfully. Sep 23 00:29:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e8d8ced-4f51-4828-ad79-fe516def4a5d tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-3d64cdd4-9aed-4b3d-a3ec-e63890006247-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-175bf36e-fd85-4d85-bf92-21dcff293873-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-175bf36e-fd85-4d85-bf92-21dcff293873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-175bf36e-fd85-4d85-bf92-21dcff293873" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-175bf36e-fd85-4d85-bf92-21dcff293873" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Deleting offline snapshot 175bf36e-fd85-4d85-bf92-21dcff293873 of volume 21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] snapshot_file for this snap is: volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4340e382-77ec-4c83-8c88-e87b2172dd14]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-76ce2a07-1234-4f10-866a-68443e9b5b5b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "cinder-76ce2a07-1234-4f10-866a-68443e9b5b5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Acquiring lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:30:00 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d818aad-d462-472c-96fb-01404ccdfea4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:30:00 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.527s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21eca989-692c-4060-9baa-83fbff3376cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac4138-ddbf-424f-9b60-91c1fa3c345d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.507s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb Sep 23 00:30:01 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b Sep 23 00:30:01 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-76ce2a07-1234-4f10-866a-68443e9b5b5b" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:30:01 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "cinder-quobyte-76ce2a07-1234-4f10-866a-68443e9b5b5b" released by "delete_volume" :: held 0.967s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Created reservations ['73b79360-4ca9-4e88-99eb-24e9d6c39768', '9c6b43cd-8afa-4ecf-b72b-754f2889b8fd', 'd36c4f6d-1d4e-4ed4-88b4-30d23595cdfb', '47abaf96-69c4-400a-a912-4ad22178b7fa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:30:01 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:02 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873 Sep 23 00:30:02 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Deleted volume successfully. Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-320c69bf-92b2-40ec-b9fc-0df75062d6f5 tempest-TestStampPattern-667061659 None] Lock "cinder-76ce2a07-1234-4f10-866a-68443e9b5b5b-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb.175bf36e-fd85-4d85-bf92-21dcff293873" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-175bf36e-fd85-4d85-bf92-21dcff293873" released by "_delete_snapshot" :: held 2.124s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" released by "delete_snapshot" :: held 2.164s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Created reservations ['0ac238d6-96eb-47cb-9bba-6208bcf572bf', 'a649e25b-ac71-4f59-b425-3fa8e394dd1e', '38d2b844-8b5e-4687-90f7-f32a4a754931', '721634d6-f6b6-4555-9be1-384f4095b4db'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Delete snapshot completed successfully. Sep 23 00:30:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b4a963b4-566d-4466-b41d-53616631a716 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-175bf36e-fd85-4d85-bf92-21dcff293873-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-21eca989-692c-4060-9baa-83fbff3376cb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-21eca989-692c-4060-9baa-83fbff3376cb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a5749-d784-458b-a5fe-14d80efe8320]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:03 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb Sep 23 00:30:03 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:04 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb Sep 23 00:30:04 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-21eca989-692c-4060-9baa-83fbff3376cb" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-quobyte-21eca989-692c-4060-9baa-83fbff3376cb" released by "delete_volume" :: held 1.004s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Created reservations ['70fb6912-2fc9-41b9-96be-ae435ce61521', '08a7beee-fa5c-4c04-b988-823c349e6f1b', '8bf0e952-8013-4541-8582-a6ab6fce4ec6', '961fb6ef-0faf-40fc-a331-f7e2beef97f4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:04 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:30:04 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:05 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:05 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Deleted volume successfully. Sep 23 00:30:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a0d23fd-89d1-49bb-86a9-b2baa71e43e5 tempest-VolumesSnapshotListTestJSON-486676708 None] Lock "cinder-21eca989-692c-4060-9baa-83fbff3376cb-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Flow 'volume_create_manager' (d929c260-26c8-4c3f-b903-35932dc22589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286a0857-5b8a-433e-abe1-09d962dfdf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286a0857-5b8a-433e-abe1-09d962dfdf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-749989100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91959a45-5004-4d8f-84e9-5c7059daee17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ad9ff1dfc9450bae8a494d19fcd4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:06Z,use_quota=True,user_id='105b15b7e8d24f9f8202401ba3e5599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19e6fbd-86b6-49b0-b334-6ca7595e6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19e6fbd-86b6-49b0-b334-6ca7595e6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d3286-f8b7-4acc-a4d6-c04f76176770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59d3286-f8b7-4acc-a4d6-c04f76176770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91959a45-5004-4d8f-84e9-5c7059daee17', 'volume_name': 'volume-91959a45-5004-4d8f-84e9-5c7059daee17', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb711c3a-57b6-4d3b-b2f3-fbfc92d7f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb711c3a-57b6-4d3b-b2f3-fbfc92d7f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1c3583-910c-422d-9ec2-876d828c016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Volume 91959a45-5004-4d8f-84e9-5c7059daee17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91959a45-5004-4d8f-84e9-5c7059daee17', 'volume_size': 1} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-749989100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91959a45-5004-4d8f-84e9-5c7059daee17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ad9ff1dfc9450bae8a494d19fcd4e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:06Z,use_quota=True,user_id='105b15b7e8d24f9f8202401ba3e5599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Creating volume 91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 1073741824 Sep 23 00:30:06 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:06 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 1073741824" returned: 0 in 0.672s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:06 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:07 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1c3583-910c-422d-9ec2-876d828c016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91959a45-5004-4d8f-84e9-5c7059daee17', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07ae124-9fe0-45b4-ba7d-28eca6cb2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Volume volume-91959a45-5004-4d8f-84e9-5c7059daee17 (91959a45-5004-4d8f-84e9-5c7059daee17): created successfully Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07ae124-9fe0-45b4-ba7d-28eca6cb2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Flow 'volume_create_manager' (d929c260-26c8-4c3f-b903-35932dc22589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8c46f687-5ca4-4413-9827-9b28bf31931b tempest-TestImageHashVerification-656590708 None] Created volume successfully. Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b5e3f-f1b5-48f9-b891-85d4d4309d93]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:09 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:09 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:09 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be1443-264b-4477-9e4c-d703e730d917]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:09 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:09 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:10 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.604s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 /opt/stack/data/cinder/conversion/91959a45-5004-4d8f-84e9-5c7059daee17.temp_image.5b9f2e33-78a9-4db2-a208-62e39829eba1ez0x_7o9.img {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:10 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 /opt/stack/data/cinder/conversion/91959a45-5004-4d8f-84e9-5c7059daee17.temp_image.5b9f2e33-78a9-4db2-a208-62e39829eba1ez0x_7o9.img Sep 23 00:30:10 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:INSERT=14,cinder:UPDATE=41,cinder:SELECT=33,cinder:DELETE=3 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:18 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 /opt/stack/data/cinder/conversion/91959a45-5004-4d8f-84e9-5c7059daee17.temp_image.5b9f2e33-78a9-4db2-a208-62e39829eba1ez0x_7o9.img" returned: 0 in 8.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd417e-0652-403a-862b-91b22df86af9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:19 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:19 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=42,cinder:INSERT=15,cinder:UPDATE=58,cinder:DELETE=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:19 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/conversion/91959a45-5004-4d8f-84e9-5c7059daee17.temp_image.5b9f2e33-78a9-4db2-a208-62e39829eba1ez0x_7o9.img {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:19 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Converted 1024.00 MB image at 118.56 MB/s Sep 23 00:30:19 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] 5b9f2e33-78a9-4db2-a208-62e39829eba1 was raw, no need to convert to raw {{(pid=87132) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Flow 'volume_create_manager' (4b7b1f4e-4b50-48da-a14a-6c47478f5eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecc935a-b7e0-4b92-b97a-112f51e54d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecc935a-b7e0-4b92-b97a-112f51e54d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-314061697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735aa569-b3a0-4f21-a4bc-7c83fe0843e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef16362571f4aa6b676273d014c77fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='559551fb22ce4d4788d01d0923df50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ec1907-5f97-448a-95d3-bb5c94592da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ec1907-5f97-448a-95d3-bb5c94592da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e0a6cf-9e2e-4883-929c-baec9c367ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e0a6cf-9e2e-4883-929c-baec9c367ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735aa569-b3a0-4f21-a4bc-7c83fe0843e6', 'volume_name': 'volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae2170b-a794-4b3d-92d9-7c29752d00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae2170b-a794-4b3d-92d9-7c29752d00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e6bf7b-303f-4a8e-9a54-df2ab7cb8292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Volume 735aa569-b3a0-4f21-a4bc-7c83fe0843e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6', 'volume_size': 1} Sep 23 00:30:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=1 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=2 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.401s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Uploaded volume to glance image-id: 5b9f2e33-78a9-4db2-a208-62e39829eba1. {{(pid=87132) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.744s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-314061697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735aa569-b3a0-4f21-a4bc-7c83fe0843e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef16362571f4aa6b676273d014c77fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='559551fb22ce4d4788d01d0923df50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Creating volume 735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:30:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 1073741824 Sep 23 00:30:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1f9d69e9-35df-4c16-b3a0-15d794204d87 tempest-TestImageHashVerification-656590708 None] Copy volume to image completed successfully. Sep 23 00:30:44 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 1073741824" returned: 0 in 0.703s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:30:45 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e6bf7b-303f-4a8e-9a54-df2ab7cb8292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef30b16-aebd-4d02-8122-9b6bf8f83570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Volume volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 (735aa569-b3a0-4f21-a4bc-7c83fe0843e6): created successfully Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef30b16-aebd-4d02-8122-9b6bf8f83570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Flow 'volume_create_manager' (4b7b1f4e-4b50-48da-a14a-6c47478f5eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (88bc5605-274d-4c15-8dd0-9009b54ecfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f373eb74-c8f8-4838-89da-db9b704bdbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-cb5a453a-4e05-492e-a8d5-b1b667841305 tempest-VolumeDependencyTests-1821256187 None] Created volume successfully. Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f373eb74-c8f8-4838-89da-db9b704bdbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1614427772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4ba63f-2291-4cd1-a381-4c98355e1d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f34fb72c-9d8c-4a88-8e9d-6a7b209a2a87),volume_type_id=f34fb72c-9d8c-4a88-8e9d-6a7b209a2a87)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95700d65-1a6e-4d09-8f49-5a32f14e764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95700d65-1a6e-4d09-8f49-5a32f14e764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ca4c4-e249-477f-a716-c3bc07279b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ca4c4-e249-477f-a716-c3bc07279b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4ba63f-2291-4cd1-a381-4c98355e1d1f', 'volume_name': 'volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0beb30-cc26-4374-833a-5f329c435aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0beb30-cc26-4374-833a-5f329c435aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d8403f-d4dd-422b-b82e-196b5a2f6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Volume 1d4ba63f-2291-4cd1-a381-4c98355e1d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f', 'volume_size': 1} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1614427772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4ba63f-2291-4cd1-a381-4c98355e1d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f34fb72c-9d8c-4a88-8e9d-6a7b209a2a87),volume_type_id=f34fb72c-9d8c-4a88-8e9d-6a7b209a2a87)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Creating volume 1d4ba63f-2291-4cd1-a381-4c98355e1d1f {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:30:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f 1073741824 Sep 23 00:30:45 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Acquiring lock "cinder-91959a45-5004-4d8f-84e9-5c7059daee17-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "cinder-91959a45-5004-4d8f-84e9-5c7059daee17-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Acquiring lock "cinder-quobyte-91959a45-5004-4d8f-84e9-5c7059daee17" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (1e2984eb-e2f5-4e81-9971-ab8df7da0164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc32d81-527f-43a6-9295-85e4c894e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc32d81-527f-43a6-9295-85e4c894e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-532299361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4165e0c-75e0-4ecb-932a-0a5cb08a7228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b875b44-96ac-4ec6-af7a-f511548a7ce6),volume_type_id=6b875b44-96ac-4ec6-af7a-f511548a7ce6)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55e7a3b-41ef-439d-855d-5db51f2f01c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55e7a3b-41ef-439d-855d-5db51f2f01c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b36a510-0661-4367-8b44-3c1eca21f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b36a510-0661-4367-8b44-3c1eca21f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4165e0c-75e0-4ecb-932a-0a5cb08a7228', 'volume_name': 'volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57039ac-7cda-4910-b79a-8276c9ae0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57039ac-7cda-4910-b79a-8276c9ae0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb8ae5d-8178-4fd9-97f0-af1a24b32e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Volume a4165e0c-75e0-4ecb-932a-0a5cb08a7228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228', 'volume_size': 1} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "cinder-quobyte-91959a45-5004-4d8f-84e9-5c7059daee17" acquired by "delete_volume" :: waited 0.203s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b158dc8c-85c5-4b9f-a7b5-c9fa0a7781f7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f 1073741824" returned: 0 in 0.676s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f Sep 23 00:30:46 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:46 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-532299361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4165e0c-75e0-4ecb-932a-0a5cb08a7228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b875b44-96ac-4ec6-af7a-f511548a7ce6),volume_type_id=6b875b44-96ac-4ec6-af7a-f511548a7ce6)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Creating volume a4165e0c-75e0-4ecb-932a-0a5cb08a7228 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.483s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 1073741824 Sep 23 00:30:47 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17 Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d8403f-d4dd-422b-b82e-196b5a2f6bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37468518-8e40-44cd-814d-6a32acdeee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Volume volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f (1d4ba63f-2291-4cd1-a381-4c98355e1d1f): created successfully Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37468518-8e40-44cd-814d-6a32acdeee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (88bc5605-274d-4c15-8dd0-9009b54ecfe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-807914d5-d78c-4c9b-8f0c-dc74b809b173 tempest-TestInstancesWithCinderVolumes-838712812 None] Created volume successfully. Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (651590de-77b5-4e31-bbe9-452973e39068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc891c9-1d68-48a4-919f-50d9505c9f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc891c9-1d68-48a4-919f-50d9505c9f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1205555196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f937d945-b711-4fea-a860-ccc8aa93c5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:47Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4963b937-2ba3-48c5-90a2-03c203f63d79),volume_type_id=4963b937-2ba3-48c5-90a2-03c203f63d79)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40f9cfd-7a37-4d97-a553-e8cbf065726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40f9cfd-7a37-4d97-a553-e8cbf065726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6852b7-9404-4602-a629-d6e45ff52066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:30:47 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-91959a45-5004-4d8f-84e9-5c7059daee17" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "cinder-quobyte-91959a45-5004-4d8f-84e9-5c7059daee17" released by "delete_volume" :: held 0.860s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Created reservations ['6672e804-881a-4cb3-9511-2ed893e4e48f', '25e03b8f-f376-4f45-97d9-b573aa94106a', '93acd03b-08ed-4e62-98d0-bd3b79d62bd5', '52245b32-3eb4-4e74-abb2-6b4c17b8fb4c'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6852b7-9404-4602-a629-d6e45ff52066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f937d945-b711-4fea-a860-ccc8aa93c5e0', 'volume_name': 'volume-f937d945-b711-4fea-a860-ccc8aa93c5e0', 'volume_size': 1, 'image_id': '20eca880-b504-46ff-91f3-7f78e2843186', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--972442626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9ddc72bd2694f04a78442259f1c9472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20eca880-b504-46ff-91f3-7f78e2843186', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20eca880-b504-46ff-91f3-7f78e2843186/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df4de09-3ddc-4b65-a8c0-87d241715aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df4de09-3ddc-4b65-a8c0-87d241715aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e3615c-d71e-40c2-9133-fec449acdac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Volume f937d945-b711-4fea-a860-ccc8aa93c5e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f937d945-b711-4fea-a860-ccc8aa93c5e0', 'volume_size': 1, 'image_id': '20eca880-b504-46ff-91f3-7f78e2843186', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--972442626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9ddc72bd2694f04a78442259f1c9472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20eca880-b504-46ff-91f3-7f78e2843186', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20eca880-b504-46ff-91f3-7f78e2843186/file', 'properties': {}}, 'image_service': } Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Trying to clone f937d945-b711-4fea-a860-ccc8aa93c5e0 from image 20eca880-b504-46ff-91f3-7f78e2843186 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 1073741824" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:30:47 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 Sep 23 00:30:47 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Deleted volume successfully. Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-490848e4-0c4d-41c0-ab00-bd2d1a0db666 tempest-TestImageHashVerification-656590708 None] Lock "cinder-91959a45-5004-4d8f-84e9-5c7059daee17-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:47 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.294s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb8ae5d-8178-4fd9-97f0-af1a24b32e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f074ea-b537-4fd8-a77e-ce459af5ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Creating offline snapshot fad7a606-29af-4226-b0a9-77c3b0877d9c of volume 735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:30:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Volume volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 (a4165e0c-75e0-4ecb-932a-0a5cb08a7228): created successfully Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f074ea-b537-4fd8-a77e-ce459af5ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (1e2984eb-e2f5-4e81-9971-ab8df7da0164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07dc76-58b3-453d-bc46-1ad0aa6ccae3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-64bbed90-8e9f-4821-abfd-d200ba6c61dc tempest-TestInstancesWithCinderVolumes-838712812 None] Created volume successfully. Sep 23 00:30:48 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:30:48 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:48 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:48 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c 1G Sep 23 00:30:48 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c 1G" returned: 0 in 0.595s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:30:49 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:49 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c is being set with open permissions: ugo+rw Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:30:49 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info Sep 23 00:30:49 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:30:49 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info" returned: 0 in 0.339s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info is being set with open permissions: ugo+rw Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info Sep 23 00:30:50 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:30:50 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.info" returned: 0 in 0.321s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9efc97fb-f020-4594-b770-665f3d5d671f tempest-VolumeDependencyTests-1821256187 None] Create snapshot completed successfully Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:30:51 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Image download 20.69 MB at 5.00 MB/s Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127b26b-dd79-49bb-a824-2ce42d670eba]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Flow 'volume_create_manager' (27c0d49e-f5cf-4f35-ab79-2629cbdca9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4e086e-974a-4de8-b980-96222e4c3d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4e086e-974a-4de8-b980-96222e4c3d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-765676088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde2d8df-af14-4c32-9ca3-6485273fc6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef16362571f4aa6b676273d014c77fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fad7a606-29af-4226-b0a9-77c3b0877d9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:52Z,use_quota=True,user_id='559551fb22ce4d4788d01d0923df50aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba41d9-0eb2-42c7-97a4-4a473b1d386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fba41d9-0eb2-42c7-97a4-4a473b1d386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff534b8-d8e0-492b-bf49-ac148544c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff534b8-d8e0-492b-bf49-ac148544c037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dde2d8df-af14-4c32-9ca3-6485273fc6d0', 'volume_name': 'volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0', 'volume_size': 1, 'snapshot_id': 'fad7a606-29af-4226-b0a9-77c3b0877d9c'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091454ac-dd80-432c-9013-858b665ae0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091454ac-dd80-432c-9013-858b665ae0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD Sep 23 00:30:51 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f1bc4d-5338-46c3-b8c9-5e11bb9fa1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Volume dde2d8df-af14-4c32-9ca3-6485273fc6d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0', 'volume_size': 1, 'snapshot_id': 'fad7a606-29af-4226-b0a9-77c3b0877d9c'} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c-dde2d8df-af14-4c32-9ca3-6485273fc6d0" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c-dde2d8df-af14-4c32-9ca3-6485273fc6d0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Creating volume dde2d8df-af14-4c32-9ca3-6485273fc6d0 from snapshot fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] snapshot: fad7a606-29af-4226-b0a9-77c3b0877d9c, volume: dde2d8df-af14-4c32-9ca3-6485273fc6d0, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a327a-55a3-4470-a915-3827dea38769]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:52 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Temporary image 20eca880-b504-46ff-91f3-7f78e2843186 is fetched for user c2b9982fd64f4c408df8cc7bfba32a36. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:30:52 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:30:52 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f889c8da-993e-4e33-83f4-a37179d01810]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:52 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD Sep 23 00:30:52 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:52 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.509s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8a8db-225f-4897-aa10-4a1471058afe]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:52 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:30:52 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:52 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:52 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:30:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:53 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 Sep 23 00:30:53 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0" returned: 0 in 6.886s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:59 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Converted 1024.00 MB image at 148.67 MB/s Sep 23 00:30:59 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 is being set with open permissions: ugo+rw Sep 23 00:30:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 Sep 23 00:30:59 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0" returned: 0 in 0.327s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" released by "_copy_volume_from_snapshot" :: held 8.269s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c-dde2d8df-af14-4c32-9ca3-6485273fc6d0" released by "_create_volume_from_snapshot" :: held 8.355s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.376s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.544s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1205555196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f937d945-b711-4fea-a860-ccc8aa93c5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ddc72bd2694f04a78442259f1c9472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:47Z,use_quota=True,user_id='c2b9982fd64f4c408df8cc7bfba32a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4963b937-2ba3-48c5-90a2-03c203f63d79),volume_type_id=4963b937-2ba3-48c5-90a2-03c203f63d79)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Creating volume f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1073741824 Sep 23 00:31:00 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f1bc4d-5338-46c3-b8c9-5e11bb9fa1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0', 'volume_size': 1, 'snapshot_id': 'fad7a606-29af-4226-b0a9-77c3b0877d9c'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073717fd-3cb6-47d8-91bf-19553807c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Volume volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 (dde2d8df-af14-4c32-9ca3-6485273fc6d0): created successfully Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073717fd-3cb6-47d8-91bf-19553807c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Flow 'volume_create_manager' (27c0d49e-f5cf-4f35-ab79-2629cbdca9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-22371fde-83cb-4e09-8133-21b10366b70d tempest-VolumeDependencyTests-1821256187 None] Created volume successfully. Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-fad7a606-29af-4226-b0a9-77c3b0877d9c-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-fad7a606-29af-4226-b0a9-77c3b0877d9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Deleting offline snapshot fad7a606-29af-4226-b0a9-77c3b0877d9c of volume 735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] snapshot_file for this snap is: volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78c4449-fe8a-4a0d-bce4-76b64e33dbb0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:31:00 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1073741824" returned: 0 in 0.539s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 Sep 23 00:31:00 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9dba6a-4042-45ca-ac3b-793fec45ce21]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:01 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:31:01 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Attempting download of 20eca880-b504-46ff-91f3-7f78e2843186 ((None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}])) to volume f937d945-b711-4fea-a860-ccc8aa93c5e0. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a07fca0-401a-412f-8254-3718a0df7411]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo Sep 23 00:31:01 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.628s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:31:01 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo Sep 23 00:31:01 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo" returned: 1 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20eca880-b504-46ff-91f3-7f78e2843186_9u4bz0uo' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dae924-7ef4-4c58-a4b0-11b044e6e374]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c Sep 23 00:31:02 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD Sep 23 00:31:02 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] 20eca880-b504-46ff-91f3-7f78e2843186 was qcow2, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:02 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6.fad7a606-29af-4226-b0a9-77c3b0877d9c" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 Sep 23 00:31:02 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-fad7a606-29af-4226-b0a9-77c3b0877d9c" released by "_delete_snapshot" :: held 2.005s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" released by "delete_snapshot" :: held 2.032s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Created reservations ['1233ce12-cd2f-4558-8abc-e7bfc1f99077', '2d6ca86c-06a3-4290-a643-9a6437de1ec4', '4284a3d1-73c1-40c5-ae8d-33f5ecfaa108', 'd9ff2916-a9d8-449f-bd24-7dd695d56813'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Delete snapshot completed successfully. Sep 23 00:31:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8c8bde6c-fa2f-4058-82ac-f98f0f03935a tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-fad7a606-29af-4226-b0a9-77c3b0877d9c-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-735aa569-b3a0-4f21-a4bc-7c83fe0843e6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-735aa569-b3a0-4f21-a4bc-7c83fe0843e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23ce28-c4a2-4f40-81da-1aa52029c4c2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:31:04 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6 Sep 23 00:31:04 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0" returned: 0 in 2.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20eca880-b504-46ff-91f3-7f78e2843186_e_x2ehqhdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:04 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Converted 112.00 MB image at 49.26 MB/s Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-735aa569-b3a0-4f21-a4bc-7c83fe0843e6" released by "delete_volume" :: held 0.939s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:04 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1G Sep 23 00:31:04 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Created reservations ['29c594b7-b5bc-4f1a-a1f5-707824ac255d', 'f2ab16a1-5d23-47d6-a1aa-1e6e9258ccb9', 'b34cbf69-e2da-4a79-9bff-5add22a982fb', '23119291-d013-45ee-a4d9-c39f93614a11'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:05 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:05 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 1G" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Downloaded image 20eca880-b504-46ff-91f3-7f78e2843186 ((None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}])) to volume f937d945-b711-4fea-a860-ccc8aa93c5e0 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Temporary image 20eca880-b504-46ff-91f3-7f78e2843186 for user c2b9982fd64f4c408df8cc7bfba32a36 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Marking volume f937d945-b711-4fea-a860-ccc8aa93c5e0 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Copying metadata from image 20eca880-b504-46ff-91f3-7f78e2843186 to f937d945-b711-4fea-a860-ccc8aa93c5e0. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Creating volume glance metadata for volume f937d945-b711-4fea-a860-ccc8aa93c5e0 backed by image 20eca880-b504-46ff-91f3-7f78e2843186 with: {'image_id': '20eca880-b504-46ff-91f3-7f78e2843186', 'image_name': 'tempest-scenario-img--972442626', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:05 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.317s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Deleted volume successfully. Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28a3b88a-28bc-418b-953e-d250c81e5634 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-735aa569-b3a0-4f21-a4bc-7c83fe0843e6-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e3615c-d71e-40c2-9133-fec449acdac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f937d945-b711-4fea-a860-ccc8aa93c5e0', 'volume_size': 1, 'image_id': '20eca880-b504-46ff-91f3-7f78e2843186', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20eca880-b504-46ff-91f3-7f78e2843186', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--972442626', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f9ddc72bd2694f04a78442259f1c9472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20eca880-b504-46ff-91f3-7f78e2843186', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20eca880-b504-46ff-91f3-7f78e2843186/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a1e0a6-ae10-4163-b981-b3d1f53f8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Volume volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 (f937d945-b711-4fea-a860-ccc8aa93c5e0): created successfully Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a1e0a6-ae10-4163-b981-b3d1f53f8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Flow 'volume_create_manager' (651590de-77b5-4e31-bbe9-452973e39068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d3f89ca7-95f6-47c6-9cf6-28b98706ecfd tempest-TestInstancesWithCinderVolumes-838712812 None] Created volume successfully. Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-dde2d8df-af14-4c32-9ca3-6485273fc6d0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-dde2d8df-af14-4c32-9ca3-6485273fc6d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787cf62-8b19-43b2-ba72-6545bd1ffc91]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 Sep 23 00:31:06 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0 Sep 23 00:31:06 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-dde2d8df-af14-4c32-9ca3-6485273fc6d0" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-quobyte-dde2d8df-af14-4c32-9ca3-6485273fc6d0" released by "delete_volume" :: held 0.763s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Created reservations ['096c29c2-3060-4cb9-b793-1d26e0f07c27', '86c1ddbc-7e57-47ca-a619-9b005fc6594e', 'd78753e7-0f87-4226-942a-3e33603c41d1', 'd0b4ff8e-7b95-4caa-9118-0924d8195985'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:07 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.366s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Deleted volume successfully. Sep 23 00:31:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86cc4062-f42d-4834-9372-a33ae9497b85 tempest-VolumeDependencyTests-1821256187 None] Lock "cinder-dde2d8df-af14-4c32-9ca3-6485273fc6d0-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-1c636e8c-fc44-4809-86ff-400d6ee34fd5 req-5bc5829a-63c8-416f-8941-fd9bb91bc654 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-1c636e8c-fc44-4809-86ff-400d6ee34fd5 req-5bc5829a-63c8-416f-8941-fd9bb91bc654 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-1c636e8c-fc44-4809-86ff-400d6ee34fd5 req-5bc5829a-63c8-416f-8941-fd9bb91bc654 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-1c636e8c-fc44-4809-86ff-400d6ee34fd5 req-5bc5829a-63c8-416f-8941-fd9bb91bc654 tempest-TestInstancesWithCinderVolumes-838712812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-f937d945-b711-4fea-a860-ccc8aa93c5e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f7d68af-8447-41ce-a6b5-2b35279d2602', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-1c636e8c-fc44-4809-86ff-400d6ee34fd5 req-5bc5829a-63c8-416f-8941-fd9bb91bc654 tempest-TestInstancesWithCinderVolumes-838712812 None] attachment_update completed successfully. Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Flow 'volume_create_manager' (8afa2593-a800-4d50-8153-4df237b1e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1180cd0e-fd3a-4c89-b2b7-6cf6abfcaa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1180cd0e-fd3a-4c89-b2b7-6cf6abfcaa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6491666e-2cde-4179-b6b2-799d874816a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ac4f1ccc004714a4aa2b6e8f1f54ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='cd9154c095814053a679d3849f693ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e566dbd0-c1c1-4deb-9486-1fc3cf091ae3),volume_type_id=e566dbd0-c1c1-4deb-9486-1fc3cf091ae3)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f3f8ca-699b-4583-8959-1a692a106f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f3f8ca-699b-4583-8959-1a692a106f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca910a6a-a0de-4289-9053-aab01ce0e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca910a6a-a0de-4289-9053-aab01ce0e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6491666e-2cde-4179-b6b2-799d874816a4', 'volume_name': 'volume-6491666e-2cde-4179-b6b2-799d874816a4', 'volume_size': 1, 'image_id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea90f8ca96bea4a09a7b69de8857f777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69ac4f1ccc004714a4aa2b6e8f1f54ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5664d76d4f82636d951b56f85a25e43a5d3e84246c3590262fbed21b36fdc7268d85199395a02bd48002ae3476c7d7c84fabd0545e6b56b01c00cc3307b77ec9', 'id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab857821-8440-4654-b8e4-16ed7435dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab857821-8440-4654-b8e4-16ed7435dd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02ca397-22da-4036-b992-90db7afd9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Volume 6491666e-2cde-4179-b6b2-799d874816a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6491666e-2cde-4179-b6b2-799d874816a4', 'volume_size': 1, 'image_id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea90f8ca96bea4a09a7b69de8857f777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69ac4f1ccc004714a4aa2b6e8f1f54ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5664d76d4f82636d951b56f85a25e43a5d3e84246c3590262fbed21b36fdc7268d85199395a02bd48002ae3476c7d7c84fabd0545e6b56b01c00cc3307b77ec9', 'id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Trying to clone 6491666e-2cde-4179-b6b2-799d874816a4 from image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:31:11 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d441630e-0471-42f6-b75e-4ca3eef11713]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:11 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:11 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:12 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:12 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:12 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Flow 'volume_create_manager' (7316b6ab-acec-40e4-8702-1f8bcd71213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdc4c74-cdaf-4ef9-a1b6-855765ee0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdc4c74-cdaf-4ef9-a1b6-855765ee0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb088b49c1d941c3a6c96e841daf2df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:12Z,use_quota=True,user_id='2ef520fa6cdc497882b3221d4b1d1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116874ac-edba-4c16-9378-7a2a7ac1f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116874ac-edba-4c16-9378-7a2a7ac1f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b297907-7e2d-4f71-8a25-23b9262e2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b297907-7e2d-4f71-8a25-23b9262e2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7', 'volume_name': 'volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30d64db-853c-45a8-a6e5-f66da5e38efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30d64db-853c-45a8-a6e5-f66da5e38efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e67d506-29e6-4350-a44c-784778755348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Volume b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7', 'volume_size': 1} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb088b49c1d941c3a6c96e841daf2df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:12Z,use_quota=True,user_id='2ef520fa6cdc497882b3221d4b1d1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Creating volume b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:12 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 1073741824 Sep 23 00:31:12 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:12 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Temporary image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 is fetched for user cd9154c095814053a679d3849f693ed7. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f50bae4-14db-47aa-8fac-c5a433d0a38f]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:12 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:12 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:13 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 1073741824" returned: 0 in 0.707s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 Sep 23 00:31:13 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:13 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:13 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:13 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:13 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 1 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6491666e-2cde-4179-b6b2-799d874816a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ac4f1ccc004714a4aa2b6e8f1f54ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='cd9154c095814053a679d3849f693ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e566dbd0-c1c1-4deb-9486-1fc3cf091ae3),volume_type_id=e566dbd0-c1c1-4deb-9486-1fc3cf091ae3)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Creating volume 6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e67d506-29e6-4350-a44c-784778755348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1073741824 Sep 23 00:31:13 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195bbb15-970a-4f48-8f6c-2c80fe33972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Volume volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 (b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7): created successfully Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195bbb15-970a-4f48-8f6c-2c80fe33972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Flow 'volume_create_manager' (7316b6ab-acec-40e4-8702-1f8bcd71213c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:13 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-41e1398c-c8e6-4eab-a52a-ff36972cac16 tempest-CinderUnicodeTest-305673623 None] Created volume successfully. Sep 23 00:31:14 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1073741824" returned: 0 in 0.907s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:14 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 Sep 23 00:31:14 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:15 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4" returned: 0 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Attempting download of 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}])) to volume 6491666e-2cde-4179-b6b2-799d874816a4. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52d2a88-2657-4387-8742-ea329a17c1b4]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:15 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0 Sep 23 00:31:15 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:15 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Flow 'volume_create_manager' (bdae9290-a8a7-4fd5-8862-ead4a17fa0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7c50b6-efd0-469f-b085-26af0a4f0694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7c50b6-efd0-469f-b085-26af0a4f0694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-211613358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381e30f-7b76-485f-b225-7d4bf04e0070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb088b49c1d941c3a6c96e841daf2df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='2ef520fa6cdc497882b3221d4b1d1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3a2cc-d478-47dc-a2fe-a9cdf1505ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3a2cc-d478-47dc-a2fe-a9cdf1505ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c195a34-10ee-4072-8a55-d9e15dca026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c195a34-10ee-4072-8a55-d9e15dca026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e381e30f-7b76-485f-b225-7d4bf04e0070', 'volume_name': 'volume-e381e30f-7b76-485f-b225-7d4bf04e0070', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58d6edc-eb6a-4023-ab3a-43458ee915a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58d6edc-eb6a-4023-ab3a-43458ee915a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56c0513-4c5c-41ad-93eb-566c5ba2b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Volume e381e30f-7b76-485f-b225-7d4bf04e0070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e381e30f-7b76-485f-b225-7d4bf04e0070', 'volume_size': 1} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-211613358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381e30f-7b76-485f-b225-7d4bf04e0070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb088b49c1d941c3a6c96e841daf2df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='2ef520fa6cdc497882b3221d4b1d1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Creating volume e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:15 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 1073741824 Sep 23 00:31:15 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:15 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0 Sep 23 00:31:15 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0" returned: 1 in 0.635s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_wj1owox0' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d54a73-ffd8-443e-acec-ccc1a0138bfe]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:16 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 1073741824" returned: 0 in 0.786s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 Sep 23 00:31:16 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:17 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56c0513-4c5c-41ad-93eb-566c5ba2b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e381e30f-7b76-485f-b225-7d4bf04e0070', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e544c-2a38-44ae-9e0f-0da881501ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Volume volume-e381e30f-7b76-485f-b225-7d4bf04e0070 (e381e30f-7b76-485f-b225-7d4bf04e0070): created successfully Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e544c-2a38-44ae-9e0f-0da881501ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Flow 'volume_create_manager' (bdae9290-a8a7-4fd5-8862-ead4a17fa0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:17 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD Sep 23 00:31:17 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-35b66e86-341c-4e7b-aae5-0daa418ee8a9 tempest-CinderUnicodeTest-305673623 None] Created volume successfully. Sep 23 00:31:17 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:17 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 Sep 23 00:31:17 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Creating offline snapshot 95e891af-bf95-4027-970e-4d5178081a24 of volume e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[073ba362-5950-410c-a65f-1f0df25f6320]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4" returned: 0 in 0.813s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62b7b9cd-7e06-46cd-9fdf-5631776c33d3_w7tganwfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:18 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1G Sep 23 00:31:18 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 Sep 23 00:31:18 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 1G Sep 23 00:31:18 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 1G" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Downloaded image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}])) to volume 6491666e-2cde-4179-b6b2-799d874816a4 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Temporary image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 for user cd9154c095814053a679d3849f693ed7 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Marking volume 6491666e-2cde-4179-b6b2-799d874816a4 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Copying metadata from image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 to 6491666e-2cde-4179-b6b2-799d874816a4. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Creating volume glance metadata for volume 6491666e-2cde-4179-b6b2-799d874816a4 backed by image 62b7b9cd-7e06-46cd-9fdf-5631776c33d3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ea90f8ca96bea4a09a7b69de8857f777', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02ca397-22da-4036-b992-90db7afd9061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6491666e-2cde-4179-b6b2-799d874816a4', 'volume_size': 1, 'image_id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea90f8ca96bea4a09a7b69de8857f777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69ac4f1ccc004714a4aa2b6e8f1f54ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5664d76d4f82636d951b56f85a25e43a5d3e84246c3590262fbed21b36fdc7268d85199395a02bd48002ae3476c7d7c84fabd0545e6b56b01c00cc3307b77ec9', 'id': '62b7b9cd-7e06-46cd-9fdf-5631776c33d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 31, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62b7b9cd-7e06-46cd-9fdf-5631776c33d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f66928a-6e9d-48e1-acab-5d4b4c6b60c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Volume volume-6491666e-2cde-4179-b6b2-799d874816a4 (6491666e-2cde-4179-b6b2-799d874816a4): created successfully Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f66928a-6e9d-48e1-acab-5d4b4c6b60c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Flow 'volume_create_manager' (8afa2593-a800-4d50-8153-4df237b1e912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ed7016c7-5ca2-4dab-a8be-d53e28c9daf4 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Created volume successfully. Sep 23 00:31:19 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 1G" returned: 0 in 0.588s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e381e30f-7b76-485f-b225-7d4bf04e0070 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e381e30f-7b76-485f-b225-7d4bf04e0070 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 Sep 23 00:31:19 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Acquiring lock "cinder-6491666e-2cde-4179-b6b2-799d874816a4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "cinder-6491666e-2cde-4179-b6b2-799d874816a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Acquiring lock "cinder-quobyte-6491666e-2cde-4179-b6b2-799d874816a4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "cinder-quobyte-6491666e-2cde-4179-b6b2-799d874816a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613b1da-5771-4f2e-9f91-3d1edc161cf8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e381e30f-7b76-485f-b225-7d4bf04e0070 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 is being set with open permissions: ugo+rw Sep 23 00:31:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 Sep 23 00:31:19 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 Sep 23 00:31:19 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info Sep 23 00:31:20 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4" returned: 0 in 0.732s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4 Sep 23 00:31:20 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info is being set with open permissions: ugo+rw Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info Sep 23 00:31:20 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6491666e-2cde-4179-b6b2-799d874816a4" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "cinder-quobyte-6491666e-2cde-4179-b6b2-799d874816a4" released by "delete_volume" :: held 1.196s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:20 devstack cinder-volume[87132]: WARNING cinder.quota [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Created reservations ['9f158382-63c5-4a9a-98b9-fa54efe02689', '98e8a135-97f0-4c92-9a97-2389e1e6d132', '5683eace-232a-4986-b102-1943bb6347f1', '3b6db031-5370-495b-8a0c-f7a4b81dd3be'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:21 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.info" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f9670540-e199-45f2-9d5e-afe8a823265d tempest-CinderUnicodeTest-305673623 None] Create snapshot completed successfully Sep 23 00:31:21 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Deleted volume successfully. Sep 23 00:31:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d8e5e44d-13f4-4898-a547-ed052117c779 tempest-VolumeAndVolumeTypeFromImageTest-1508440682 None] Lock "cinder-6491666e-2cde-4179-b6b2-799d874816a4-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-95e891af-bf95-4027-970e-4d5178081a24-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-95e891af-bf95-4027-970e-4d5178081a24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-quobyte-95e891af-bf95-4027-970e-4d5178081a24" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-95e891af-bf95-4027-970e-4d5178081a24" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Deleting offline snapshot 95e891af-bf95-4027-970e-4d5178081a24 of volume e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] snapshot_file for this snap is: volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad08bc4-d209-4805-a960-1c1dfb55a64a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 Sep 23 00:31:22 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24" returned: 0 in 0.693s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e381e30f-7b76-485f-b225-7d4bf04e0070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffcdfc-2b3f-4088-8b8a-af4a3598de2b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 Sep 23 00:31:23 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070" returned: 0 in 0.695s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 Sep 23 00:31:24 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24" returned: 0 in 0.588s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24 Sep 23 00:31:24 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:25 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070.95e891af-bf95-4027-970e-4d5178081a24" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-95e891af-bf95-4027-970e-4d5178081a24" released by "_delete_snapshot" :: held 2.634s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" released by "delete_snapshot" :: held 2.679s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Created reservations ['6e9cf196-7b21-46c0-9896-d20d61c73a16', '6b9158a5-acf2-4ad9-ab84-b6aca8cdd6d8', '16cea2c4-c177-41cc-83c0-feb0d3efa4be', 'ca5108a4-861f-41e5-b637-83f845386e1a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Delete snapshot completed successfully. Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-00899008-b20e-41a8-91fa-6a15822fafdb tempest-CinderUnicodeTest-305673623 None] Lock "cinder-95e891af-bf95-4027-970e-4d5178081a24-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-e381e30f-7b76-485f-b225-7d4bf04e0070-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "cinder-e381e30f-7b76-485f-b225-7d4bf04e0070-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afdcc1f-769c-441b-858f-d4e2d10e5426]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 Sep 23 00:31:26 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070" returned: 0 in 0.647s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070 Sep 23 00:31:26 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e381e30f-7b76-485f-b225-7d4bf04e0070" returned: 0 in 0.459s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-e381e30f-7b76-485f-b225-7d4bf04e0070" released by "delete_volume" :: held 1.240s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Created reservations ['ac5fb539-2dd1-4b7d-84b7-e740b9b0c01a', '77df14d9-3932-45c6-a341-78b0cf1d446c', 'b6910e9e-990a-4ad2-96f4-3398c4cd1215', '26b54bdd-d646-47ea-8d06-3386d92c730f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:27 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:27 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Deleted volume successfully. Sep 23 00:31:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-068d9c30-2ec4-4070-a6dd-4ce59c03e258 tempest-CinderUnicodeTest-305673623 None] Lock "cinder-e381e30f-7b76-485f-b225-7d4bf04e0070-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "cinder-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Acquiring lock "cinder-quobyte-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58fd2a3-d593-4f0a-a2da-a0cb24c44897]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:28 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 Sep 23 00:31:28 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:28 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:28 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7 Sep 23 00:31:28 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "cinder-quobyte-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7" released by "delete_volume" :: held 0.798s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Created reservations ['809c7b84-02f1-4fc1-86fe-63e0c9a03120', '254096cb-c589-4601-9e3a-5bf20efe34a1', '1a1751f6-580a-474e-ac26-4f364941fc28', '6f42b01a-0679-4869-a88e-1262f0b12744'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:29 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:29 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (296994af-593e-4178-9092-f8392eaf4891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263ef8b-74a5-4c24-973f-5366f71893f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263ef8b-74a5-4c24-973f-5366f71893f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1449656178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a59252b-c97c-4374-958f-71c6ebe70255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:30Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23849557-42f2-4c3c-9726-c41482303be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23849557-42f2-4c3c-9726-c41482303be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b910c1-5650-4efb-920b-dfcae677f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b910c1-5650-4efb-920b-dfcae677f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a59252b-c97c-4374-958f-71c6ebe70255', 'volume_name': 'volume-2a59252b-c97c-4374-958f-71c6ebe70255', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5ac404-a9a4-4194-be1a-84788178e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5ac404-a9a4-4194-be1a-84788178e87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351fd83a-acd1-4cd8-94f3-fcce766f74c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume 2a59252b-c97c-4374-958f-71c6ebe70255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a59252b-c97c-4374-958f-71c6ebe70255', 'volume_size': 1} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1449656178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a59252b-c97c-4374-958f-71c6ebe70255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:30Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume 2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:29 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Deleted volume successfully. Sep 23 00:31:29 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 1073741824 Sep 23 00:31:29 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4e1cf074-924a-4baf-89a4-1f1694c77bec tempest-CinderUnicodeTest-305673623 None] Lock "cinder-b42461ee-3ed7-4f0d-91fa-5d0d0e1102c7-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:30 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 1073741824" returned: 0 in 0.592s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:30 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 Sep 23 00:31:30 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:30 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351fd83a-acd1-4cd8-94f3-fcce766f74c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a59252b-c97c-4374-958f-71c6ebe70255', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0f7cc5-db89-4426-b4ad-d5b5c448feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-2a59252b-c97c-4374-958f-71c6ebe70255 (2a59252b-c97c-4374-958f-71c6ebe70255): created successfully Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0f7cc5-db89-4426-b4ad-d5b5c448feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (296994af-593e-4178-9092-f8392eaf4891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9a48f6c8-5002-4fa7-bd97-9b80289eceb5 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating offline snapshot 7f88628d-dd1e-4301-93b2-f25f595b6c99 of volume 2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4391fe0-f896-4d9f-84a6-1b6fbee39e02]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:32 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 Sep 23 00:31:32 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:32 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:32 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 1G Sep 23 00:31:32 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:33 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 1G" returned: 0 in 0.558s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a59252b-c97c-4374-958f-71c6ebe70255 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:33 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a59252b-c97c-4374-958f-71c6ebe70255 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 Sep 23 00:31:33 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:33 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a59252b-c97c-4374-958f-71c6ebe70255 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:33 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 is being set with open permissions: ugo+rw Sep 23 00:31:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:33 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 Sep 23 00:31:33 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info Sep 23 00:31:34 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info is being set with open permissions: ugo+rw Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info Sep 23 00:31:34 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.info" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bdb61f1d-72d2-4af8-92f9-27506478eb68 tempest-CreateVolumesFromSnapshotTest-421721224 None] Create snapshot completed successfully Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (a8c23f92-143e-43cc-b6a4-43d4784b2afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e05e59-7e15-4054-a663-e0d3f636ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e05e59-7e15-4054-a663-e0d3f636ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837042972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4131ba23-9e8e-4f1d-a71c-aed6d38d3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:36Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65663127-af6d-4e6e-81ad-1a9cf58a8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65663127-af6d-4e6e-81ad-1a9cf58a8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c5989-b2b6-46e2-9523-4e244606cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c5989-b2b6-46e2-9523-4e244606cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4131ba23-9e8e-4f1d-a71c-aed6d38d3128', 'volume_name': 'volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa6a85-e7a5-48de-8f4c-59c1259a9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa6a85-e7a5-48de-8f4c-59c1259a9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86442529-c4f1-438f-b069-44d05bc715d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume 4131ba23-9e8e-4f1d-a71c-aed6d38d3128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128', 'volume_size': 1} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837042972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4131ba23-9e8e-4f1d-a71c-aed6d38d3128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:36Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume 4131ba23-9e8e-4f1d-a71c-aed6d38d3128 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:36 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 1073741824 Sep 23 00:31:36 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (fe91f253-1a69-4faf-af00-c452222c60b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f1784-25df-43fa-a6fd-da9dc54a9e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f1784-25df-43fa-a6fd-da9dc54a9e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740915813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410d6ba5-7c77-4956-9357-4212930fbe10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:36Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f04f50-fc53-4d65-acc9-e33647808a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f04f50-fc53-4d65-acc9-e33647808a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150f1820-2d97-4bcf-9251-39a009aae9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150f1820-2d97-4bcf-9251-39a009aae9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410d6ba5-7c77-4956-9357-4212930fbe10', 'volume_name': 'volume-410d6ba5-7c77-4956-9357-4212930fbe10', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d54ac36-c8bd-4411-b80d-3a72882c6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d54ac36-c8bd-4411-b80d-3a72882c6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ffbc0b-49fc-4440-b9a8-65b4fc8cb537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume 410d6ba5-7c77-4956-9357-4212930fbe10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410d6ba5-7c77-4956-9357-4212930fbe10', 'volume_size': 1} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:36 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 1073741824" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:36 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 Sep 23 00:31:36 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (425827b5-9856-4d73-99dd-36d4065459df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de698eef-76f3-40fb-9c2a-5307cbd628ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de698eef-76f3-40fb-9c2a-5307cbd628ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156382722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2af2fe-cb1f-4990-aa08-32ef3cb59a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:37Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd534a0b-5e9c-4387-a221-80907dd45247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd534a0b-5e9c-4387-a221-80907dd45247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac68a587-091e-4a83-b882-ef37d9d39f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac68a587-091e-4a83-b882-ef37d9d39f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2af2fe-cb1f-4990-aa08-32ef3cb59a28', 'volume_name': 'volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27605e12-a1b5-450e-b4f0-04f0781714f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27605e12-a1b5-450e-b4f0-04f0781714f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b0cbe-47cf-47a1-afea-6d65d84b23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume 5c2af2fe-cb1f-4990-aa08-32ef3cb59a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28', 'volume_size': 1} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:37 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-740915813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410d6ba5-7c77-4956-9357-4212930fbe10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:36Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume 410d6ba5-7c77-4956-9357-4212930fbe10 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86442529-c4f1-438f-b069-44d05bc715d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 1073741824 Sep 23 00:31:37 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c6521-cbd0-45a0-bbd2-eb866f44d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 (4131ba23-9e8e-4f1d-a71c-aed6d38d3128): created successfully Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c6521-cbd0-45a0-bbd2-eb866f44d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (a8c23f92-143e-43cc-b6a4-43d4784b2afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-759ae0b3-4fa0-4804-aaa0-0744b4cd2789 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (13dd5f08-53be-470d-b0c1-0925257e6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6160f42-e67f-476d-a0f5-c9b5764b0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6160f42-e67f-476d-a0f5-c9b5764b0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79426693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84d2364-15ba-41bc-b57e-6092c56a8a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:37Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7357886e-e720-4ae0-9c74-5f242e66576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7357886e-e720-4ae0-9c74-5f242e66576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244289be-a8f0-486f-b683-74ecbca19c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244289be-a8f0-486f-b683-74ecbca19c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84d2364-15ba-41bc-b57e-6092c56a8a6e', 'volume_name': 'volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1b5269-dece-4eee-9e23-a91c2dcf96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1b5269-dece-4eee-9e23-a91c2dcf96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c41881-b16f-4925-874b-a0b74d0c8996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume d84d2364-15ba-41bc-b57e-6092c56a8a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e', 'volume_size': 1} Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:37 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 1073741824" returned: 0 in 0.678s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (23174504-1a90-4949-bebf-da73c008747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ce0e5a-2a56-4745-98e8-34cdf7f41b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ce0e5a-2a56-4745-98e8-34cdf7f41b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744581170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db4a5a-3956-43d1-9b00-03cdd4dc0939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:38Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff236ef8-c1dc-4de5-990c-6f815c527a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff236ef8-c1dc-4de5-990c-6f815c527a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9fd67f-5f11-477c-8316-99fb6fb91675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9fd67f-5f11-477c-8316-99fb6fb91675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3db4a5a-3956-43d1-9b00-03cdd4dc0939', 'volume_name': 'volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8f71d7-7c29-4e73-9fde-7081aec10b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8f71d7-7c29-4e73-9fde-7081aec10b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c81965f-3cdd-4542-8afe-627a09f08763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume b3db4a5a-3956-43d1-9b00-03cdd4dc0939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939', 'volume_size': 1} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:38 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 Sep 23 00:31:38 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:38 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156382722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2af2fe-cb1f-4990-aa08-32ef3cb59a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:37Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume 5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ffbc0b-49fc-4440-b9a8-65b4fc8cb537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410d6ba5-7c77-4956-9357-4212930fbe10', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 1073741824 Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc320c32-c78e-4af6-8e0d-9579e1eb5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:38 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-410d6ba5-7c77-4956-9357-4212930fbe10 (410d6ba5-7c77-4956-9357-4212930fbe10): created successfully Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc320c32-c78e-4af6-8e0d-9579e1eb5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (fe91f253-1a69-4faf-af00-c452222c60b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4bcee132-c2d8-4428-8145-0911f3d316ca tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:38 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 1073741824" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:39 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 Sep 23 00:31:39 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:39 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79426693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84d2364-15ba-41bc-b57e-6092c56a8a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:37Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume d84d2364-15ba-41bc-b57e-6092c56a8a6e {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:39 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e 1073741824 Sep 23 00:31:39 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b0cbe-47cf-47a1-afea-6d65d84b23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e83bfa-691d-40b4-98a9-a1d3ae081a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 (5c2af2fe-cb1f-4990-aa08-32ef3cb59a28): created successfully Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e83bfa-691d-40b4-98a9-a1d3ae081a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (425827b5-9856-4d73-99dd-36d4065459df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fb7c6b9e-64a5-4640-88f4-24c2ac6c1e5f tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:39 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e 1073741824" returned: 0 in 0.550s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=104,cinder:UPDATE=106,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=105,cinder:SELECT=90,cinder:DELETE=10,cinder:INSERT=27 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:39 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e Sep 23 00:31:39 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:40 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744581170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db4a5a-3956-43d1-9b00-03cdd4dc0939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7878ef5adfc4c49ba51e0597a2d232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:38Z,use_quota=True,user_id='88a5bd4c35dd4453a2f84785aadb5006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Creating volume b3db4a5a-3956-43d1-9b00-03cdd4dc0939 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c41881-b16f-4925-874b-a0b74d0c8996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 1073741824 Sep 23 00:31:40 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46982637-b8cb-4cb5-8820-0cc446c17cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e (d84d2364-15ba-41bc-b57e-6092c56a8a6e): created successfully Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46982637-b8cb-4cb5-8820-0cc446c17cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (13dd5f08-53be-470d-b0c1-0925257e6156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5968bc4d-ae0c-4d2d-bdaa-f85bf508019d tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:40 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 1073741824" returned: 0 in 0.589s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:40 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 Sep 23 00:31:40 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:41 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c81965f-3cdd-4542-8afe-627a09f08763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f54b02-018e-4509-8a5d-11d8f91d86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Volume volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 (b3db4a5a-3956-43d1-9b00-03cdd4dc0939): created successfully Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f54b02-018e-4509-8a5d-11d8f91d86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Flow 'volume_create_manager' (23174504-1a90-4949-bebf-da73c008747c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:41 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-48a95b48-948d-4ae3-8d18-c922446e30a4 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created volume successfully. Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-b3db4a5a-3956-43d1-9b00-03cdd4dc0939-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-b3db4a5a-3956-43d1-9b00-03cdd4dc0939-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[189e75a4-bc54-494d-96fe-51a4dff41293]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:41 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 Sep 23 00:31:41 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:42 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:42 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939 Sep 23 00:31:42 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:42 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-b3db4a5a-3956-43d1-9b00-03cdd4dc0939" released by "delete_volume" :: held 0.785s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['09b2f354-37d2-4dad-9787-bf5689b8a870', '1f0a21d3-d100-4665-a23f-aa23f2eb18c0', '8496a4d6-e661-431f-a08e-035d755adfcf', 'accd3edb-7219-4f2a-910f-7262f9861593'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:42 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:42 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-d84d2364-15ba-41bc-b57e-6092c56a8a6e-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-d84d2364-15ba-41bc-b57e-6092c56a8a6e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-d84d2364-15ba-41bc-b57e-6092c56a8a6e" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-d84d2364-15ba-41bc-b57e-6092c56a8a6e" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20aaf0-191f-43e0-9ea6-08d242aea9db]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:43 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4a34c5b9-fa46-423f-bf44-bc3af75eae64 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-b3db4a5a-3956-43d1-9b00-03cdd4dc0939-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:43 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e Sep 23 00:31:43 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:43 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e" returned: 0 in 0.544s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:43 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e Sep 23 00:31:43 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:43 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-d84d2364-15ba-41bc-b57e-6092c56a8a6e" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-d84d2364-15ba-41bc-b57e-6092c56a8a6e" released by "delete_volume" :: held 1.004s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['c392182e-792f-46c9-9cc4-77c75b648ce2', '22c2faf1-60ea-4f9d-a2f0-4c6e9fb365f1', '53a57265-f7fc-458a-97f1-9dbadf667fb4', '2e5ea260-886c-467c-a3d1-a40bb6e3aba9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:44 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:44 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:44 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-89959515-823b-4214-9ce2-2f3d208ea445 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-d84d2364-15ba-41bc-b57e-6092c56a8a6e-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[466fbf6f-076a-4f6c-8755-1944d91ac92a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:45 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 Sep 23 00:31:45 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:45 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:45 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28 Sep 23 00:31:45 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" returned: 0 in 0.323s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28" released by "delete_volume" :: held 0.836s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['daea7668-2ef0-4cae-b254-8c1ba36a6f65', 'ee2ea67c-c15e-4b22-943c-4049d5816154', 'e1ab4454-f785-4a3d-8a80-354b98d0a00b', '12a93a63-9bb9-4508-b642-02f4126de239'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:46 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:46 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-410d6ba5-7c77-4956-9357-4212930fbe10-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-410d6ba5-7c77-4956-9357-4212930fbe10-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-410d6ba5-7c77-4956-9357-4212930fbe10" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-410d6ba5-7c77-4956-9357-4212930fbe10" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[714bf0d6-e685-40b1-8e15-1a79c6788f17]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:46 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a989d845-b947-467c-82f6-d6dcd5fa48f6 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-5c2af2fe-cb1f-4990-aa08-32ef3cb59a28-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:46 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 Sep 23 00:31:46 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:47 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10" returned: 0 in 0.689s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:47 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10 Sep 23 00:31:47 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:47 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-410d6ba5-7c77-4956-9357-4212930fbe10" returned: 0 in 0.521s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-410d6ba5-7c77-4956-9357-4212930fbe10" released by "delete_volume" :: held 1.283s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['a9a4a0bc-e114-4719-ba4f-b5023be9b59e', 'eaa17382-a7e8-4507-81a4-1c1cca90339e', '5a98dd5f-b01d-437e-946c-5cddf98a71e3', '72894c5b-48df-47e8-a50d-afe8b095f770'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:48 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78f0c1af-30f6-4576-bd05-2fe19a785126 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-410d6ba5-7c77-4956-9357-4212930fbe10-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-6db55aa8-338c-45cd-8c3f-a0efad2f373d req-5188ccd7-0aba-466c-b6ed-f5f16d2acc63 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-6db55aa8-338c-45cd-8c3f-a0efad2f373d req-5188ccd7-0aba-466c-b6ed-f5f16d2acc63 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-6db55aa8-338c-45cd-8c3f-a0efad2f373d req-5188ccd7-0aba-466c-b6ed-f5f16d2acc63 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-6db55aa8-338c-45cd-8c3f-a0efad2f373d req-5188ccd7-0aba-466c-b6ed-f5f16d2acc63 tempest-TestInstancesWithCinderVolumes-838712812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '013c52b7-d422-4781-8e80-b0404c059871', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-6db55aa8-338c-45cd-8c3f-a0efad2f373d req-5188ccd7-0aba-466c-b6ed-f5f16d2acc63 tempest-TestInstancesWithCinderVolumes-838712812 None] attachment_update completed successfully. Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-4131ba23-9e8e-4f1d-a71c-aed6d38d3128-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-4131ba23-9e8e-4f1d-a71c-aed6d38d3128-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5487d574-6eed-4211-9f49-42c188765a1b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 Sep 23 00:31:49 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" returned: 0 in 0.592s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128 Sep 23 00:31:49 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:49 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:50 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" returned: 0 in 0.385s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-4131ba23-9e8e-4f1d-a71c-aed6d38d3128" released by "delete_volume" :: held 1.054s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['cbe00704-beb9-4073-a144-eab9cb2b0c61', '0286430d-6af9-424f-abce-9a953bc51d61', '52cd4494-ec45-4024-ac9f-7d7b4b7fdae3', '448619b1-e43f-4fac-8f77-cf8496f4e502'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:50 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.402s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:50 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:50 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1d04332e-09be-4afa-baa0-d1ad30651d82 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-4131ba23-9e8e-4f1d-a71c-aed6d38d3128-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-7f88628d-dd1e-4301-93b2-f25f595b6c99-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-7f88628d-dd1e-4301-93b2-f25f595b6c99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-7f88628d-dd1e-4301-93b2-f25f595b6c99" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-7f88628d-dd1e-4301-93b2-f25f595b6c99" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleting offline snapshot 7f88628d-dd1e-4301-93b2-f25f595b6c99 of volume 2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] snapshot_file for this snap is: volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66ab4b-f088-420f-b9c6-9749935c4749]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 Sep 23 00:31:51 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99" returned: 0 in 0.516s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a59252b-c97c-4374-958f-71c6ebe70255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa42a56-6815-4cf8-abf1-23f6e30ebdc6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 Sep 23 00:31:52 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255" returned: 0 in 0.582s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:52 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 Sep 23 00:31:52 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5c1e10a9-d41c-4e4b-96dc-7643f26bd4e7 req-76ef5a61-b619-45c8-818d-f578f0dbb3e5 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5c1e10a9-d41c-4e4b-96dc-7643f26bd4e7 req-76ef5a61-b619-45c8-818d-f578f0dbb3e5 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [req-5c1e10a9-d41c-4e4b-96dc-7643f26bd4e7 req-76ef5a61-b619-45c8-818d-f578f0dbb3e5 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-5c1e10a9-d41c-4e4b-96dc-7643f26bd4e7 req-76ef5a61-b619-45c8-818d-f578f0dbb3e5 tempest-TestInstancesWithCinderVolumes-838712812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075', 'name': 'volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '714ffbac-0b83-4d13-8765-3d9c3cb3869e', 'enforce_multipath': True} {{(pid=87132) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-5c1e10a9-d41c-4e4b-96dc-7643f26bd4e7 req-76ef5a61-b619-45c8-818d-f578f0dbb3e5 tempest-TestInstancesWithCinderVolumes-838712812 None] attachment_update completed successfully. Sep 23 00:31:53 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99 Sep 23 00:31:53 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255.7f88628d-dd1e-4301-93b2-f25f595b6c99" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-7f88628d-dd1e-4301-93b2-f25f595b6c99" released by "_delete_snapshot" :: held 2.203s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" released by "delete_snapshot" :: held 2.249s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['c2e94654-d2a7-45fa-bb22-dd7e82adba3e', '0c46644d-ec5b-4867-a75e-56cc3f9e05e0', 'bab5c7a4-6672-46e6-b57f-c75dadb00df2', '72eb0711-0d5f-4501-b9b3-9088f02d19e8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Delete snapshot completed successfully. Sep 23 00:31:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-c76cd6eb-a36b-4716-a90f-6d185a588356 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-7f88628d-dd1e-4301-93b2-f25f595b6c99-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-2a59252b-c97c-4374-958f-71c6ebe70255-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-2a59252b-c97c-4374-958f-71c6ebe70255-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337a74d-3c50-49ec-9212-e27c3e9a18e4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 Sep 23 00:31:55 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:55 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255 Sep 23 00:31:55 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2a59252b-c97c-4374-958f-71c6ebe70255" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-quobyte-2a59252b-c97c-4374-958f-71c6ebe70255" released by "delete_volume" :: held 0.953s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Created reservations ['c0c0fae7-1f66-459b-8fe3-182dc9492a7a', '2dc646a2-f624-42bc-813a-5cc14b62a34d', '66a78586-e19e-4f8e-9d0a-bdca0ab1de42', '17835878-f261-45b2-848f-612993c466c2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:31:56 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:56 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:56 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Deleted volume successfully. Sep 23 00:31:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b9c2c71-50d1-4373-ae95-96f783b022c3 tempest-CreateVolumesFromSnapshotTest-421721224 None] Lock "cinder-2a59252b-c97c-4374-958f-71c6ebe70255-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-564e6103-fc74-42b4-be4d-5db5f3369394 req-6e254b3f-46cd-4e5c-a293-13112884e122 tempest-TestInstancesWithCinderVolumes-838712812 None] Terminate volume connection completed successfully. Sep 23 00:32:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-564e6103-fc74-42b4-be4d-5db5f3369394 req-6e254b3f-46cd-4e5c-a293-13112884e122 tempest-TestInstancesWithCinderVolumes-838712812 None] Deleting attachment 013c52b7-d422-4781-8e80-b0404c059871. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-1d4ba63f-2291-4cd1-a381-4c98355e1d1f-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-1d4ba63f-2291-4cd1-a381-4c98355e1d1f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-quobyte-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fe2b31-0c65-4722-b512-d06ed0c4ceca]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f Sep 23 00:32:01 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" returned: 0 in 0.627s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (572c27a3-3106-4f30-b069-925fc71c81d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:01 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f Sep 23 00:32:01 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b46e9a-ad02-4184-99b7-b958197793ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b46e9a-ad02-4184-99b7-b958197793ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177443044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe075dc2-85d9-4300-a993-ea8f7c3928cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:02Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c514e7a-1c6c-435f-894a-14a2791633ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c514e7a-1c6c-435f-894a-14a2791633ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25212373-9cae-4aea-bab8-523d2aec25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25212373-9cae-4aea-bab8-523d2aec25c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe075dc2-85d9-4300-a993-ea8f7c3928cd', 'volume_name': 'volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b230ae-4313-4d82-bb58-742bcfb31455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b230ae-4313-4d82-bb58-742bcfb31455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a367c37-656d-49e8-b407-cb4dd4def463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume fe075dc2-85d9-4300-a993-ea8f7c3928cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd', 'volume_size': 1} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177443044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe075dc2-85d9-4300-a993-ea8f7c3928cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:02Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume fe075dc2-85d9-4300-a993-ea8f7c3928cd {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd 1073741824 Sep 23 00:32:02 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:02 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-1d4ba63f-2291-4cd1-a381-4c98355e1d1f" released by "delete_volume" :: held 1.214s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:02 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140015176-1924968968 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140015176-1924968968, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:02 devstack cinder-volume[87132]: WARNING cinder.quota [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140015176-1924968968 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-140015176-1924968968, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Created reservations ['1e1f8635-da68-4f62-bd8a-b827a652f0d3', '20c218dc-e9a3-41c5-99cf-abd8578d29d5', 'f0cfb295-c019-4a4b-a6e0-16a181cbe050', 'bee4d20e-2754-4255-adf2-6717a2536693'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:02 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:02 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd 1073741824" returned: 0 in 0.754s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd Sep 23 00:32:02 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:02 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Deleted volume successfully. Sep 23 00:32:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5ba21720-6cb1-4a2a-ad8e-51eed8458cf6 tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-1d4ba63f-2291-4cd1-a381-4c98355e1d1f-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:03 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a367c37-656d-49e8-b407-cb4dd4def463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d68ce-4c70-4cd5-9f6e-65577cc4a001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd (fe075dc2-85d9-4300-a993-ea8f7c3928cd): created successfully Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d68ce-4c70-4cd5-9f6e-65577cc4a001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (572c27a3-3106-4f30-b069-925fc71c81d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b806b22-120d-4433-91da-bd797a22df05 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (bd6b8958-0b02-4343-be93-6add1a14f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8707481-5621-4d7b-a529-4bc2e9414fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8707481-5621-4d7b-a529-4bc2e9414fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010115925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d12aed0-57d8-404d-8431-7d2874a92032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13abd376-87ee-434f-b086-9b6c8032f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13abd376-87ee-434f-b086-9b6c8032f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fa8e0-c8ae-4232-8b64-1903473b81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fa8e0-c8ae-4232-8b64-1903473b81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d12aed0-57d8-404d-8431-7d2874a92032', 'volume_name': 'volume-1d12aed0-57d8-404d-8431-7d2874a92032', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cced27-9a0d-44bb-9e1b-00240b19b508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cced27-9a0d-44bb-9e1b-00240b19b508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9fdb3a-edf4-407a-ae9c-dc9165e9b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume 1d12aed0-57d8-404d-8431-7d2874a92032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d12aed0-57d8-404d-8431-7d2874a92032', 'volume_size': 1} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010115925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d12aed0-57d8-404d-8431-7d2874a92032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume 1d12aed0-57d8-404d-8431-7d2874a92032 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:04 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 1073741824 Sep 23 00:32:04 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (c089ea16-c9ed-430a-bbc0-afcfbe25a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2087d3d-9209-4238-a6c6-ca75fce86f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2087d3d-9209-4238-a6c6-ca75fce86f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942987688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c45ad73-5ef1-46c6-bdb3-2e489f390659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0652597f-227c-4fdf-ac53-d6eb2266ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0652597f-227c-4fdf-ac53-d6eb2266ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde28be-b151-41ee-9a90-d77aa0632f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdde28be-b151-41ee-9a90-d77aa0632f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c45ad73-5ef1-46c6-bdb3-2e489f390659', 'volume_name': 'volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ecaf9-1526-4fa5-996d-259ea2ab839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ecaf9-1526-4fa5-996d-259ea2ab839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da0fa0f-b59c-4817-8a25-120324dbbc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume 5c45ad73-5ef1-46c6-bdb3-2e489f390659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659', 'volume_size': 1} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 1073741824" returned: 0 in 0.880s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:05 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 Sep 23 00:32:05 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (1233b168-0fd2-4c0b-983d-c337ece56114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe93e496-20f2-470a-be83-9aaaf35b1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe93e496-20f2-470a-be83-9aaaf35b1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930069942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e434355-5eae-4f19-8562-1d447d44ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:06Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9383414c-6994-474c-80f7-3bb08f9941f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9383414c-6994-474c-80f7-3bb08f9941f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c899c92-61fb-4692-93eb-8572633655a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c899c92-61fb-4692-93eb-8572633655a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e434355-5eae-4f19-8562-1d447d44ede2', 'volume_name': 'volume-1e434355-5eae-4f19-8562-1d447d44ede2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8297c0e-837f-495c-b265-0eeef984e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8297c0e-837f-495c-b265-0eeef984e551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb413ecf-4926-4966-9e69-428375668990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume 1e434355-5eae-4f19-8562-1d447d44ede2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e434355-5eae-4f19-8562-1d447d44ede2', 'volume_size': 1} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:06 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032" returned: 0 in 0.522s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942987688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c45ad73-5ef1-46c6-bdb3-2e489f390659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume 5c45ad73-5ef1-46c6-bdb3-2e489f390659 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:06 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 1073741824 Sep 23 00:32:06 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9fdb3a-edf4-407a-ae9c-dc9165e9b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d12aed0-57d8-404d-8431-7d2874a92032', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4900453-9b03-4c07-9465-4ca2698902bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-1d12aed0-57d8-404d-8431-7d2874a92032 (1d12aed0-57d8-404d-8431-7d2874a92032): created successfully Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4900453-9b03-4c07-9465-4ca2698902bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (bd6b8958-0b02-4343-be93-6add1a14f47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e6cf707d-8aa9-4f3f-b4ee-7bf106add222 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (6908741b-5bd4-4dc5-9d15-418e27ceacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af90362f-2f0d-4f9a-943b-5782dfcf0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-0ad64655-53e1-410a-b431-8a5823b6cb89 req-1e99d173-e646-4c57-95e7-a8efb6ddc0cc tempest-TestInstancesWithCinderVolumes-838712812 None] Terminate volume connection completed successfully. Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-0ad64655-53e1-410a-b431-8a5823b6cb89 req-1e99d173-e646-4c57-95e7-a8efb6ddc0cc tempest-TestInstancesWithCinderVolumes-838712812 None] Deleting attachment 714ffbac-0b83-4d13-8765-3d9c3cb3869e. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af90362f-2f0d-4f9a-943b-5782dfcf0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316298840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eff95f0-bf8e-4cc7-8507-169dd0821d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bba31d-5daf-4aba-ba7c-76775dd7fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bba31d-5daf-4aba-ba7c-76775dd7fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b74c07-bbf9-45e8-b980-fe8e6eb4fc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b74c07-bbf9-45e8-b980-fe8e6eb4fc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eff95f0-bf8e-4cc7-8507-169dd0821d91', 'volume_name': 'volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce1034-ec14-4869-9d87-3cbd79f6f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ce1034-ec14-4869-9d87-3cbd79f6f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d1ab29-c6db-4795-a708-f9271905a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume 9eff95f0-bf8e-4cc7-8507-169dd0821d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91', 'volume_size': 1} Sep 23 00:32:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:07 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 1073741824" returned: 0 in 0.858s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-a4165e0c-75e0-4ecb-932a-0a5cb08a7228-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:07 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 Sep 23 00:32:07 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (0ec963da-2aaa-41fa-a728-736f44df326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3def8d61-9a74-4f13-8796-6be935429fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-a4165e0c-75e0-4ecb-932a-0a5cb08a7228-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3def8d61-9a74-4f13-8796-6be935429fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304073015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db478637-94fc-45e6-bf97-e621a361c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db478637-94fc-45e6-bf97-e621a361c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8141c341-69d1-404a-a058-43125fdd97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8141c341-69d1-404a-a058-43125fdd97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3', 'volume_name': 'volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caba7a3-fc38-4d9d-bd6f-d770d14be5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9caba7a3-fc38-4d9d-bd6f-d770d14be5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe361e-34a8-4517-a275-fa4a9311f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume 18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3', 'volume_size': 1} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-quobyte-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd6b501-e494-4a14-a02d-eb876282e5ec]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930069942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e434355-5eae-4f19-8562-1d447d44ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:06Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume 1e434355-5eae-4f19-8562-1d447d44ede2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:07 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 Sep 23 00:32:07 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 1073741824 Sep 23 00:32:07 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da0fa0f-b59c-4817-8a25-120324dbbc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aece269-a8eb-4f10-888a-952102b15e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 (5c45ad73-5ef1-46c6-bdb3-2e489f390659): created successfully Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aece269-a8eb-4f10-888a-952102b15e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (c089ea16-c9ed-430a-bbc0-afcfbe25a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-43132ae2-4c87-4a40-bff7-3d1e67d2ae6e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:08 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" returned: 0 in 0.662s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228 Sep 23 00:32:08 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 1073741824" returned: 0 in 0.743s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 Sep 23 00:32:08 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-a4165e0c-75e0-4ecb-932a-0a5cb08a7228" released by "delete_volume" :: held 1.217s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:08 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1025346039-1822468441 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1025346039-1822468441, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:08 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1025346039-1822468441 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1025346039-1822468441, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Created reservations ['4327f1ac-e177-4c93-8bec-e5c4e976c004', '304c8925-f53f-402b-b747-a3d8b7b69519', '8ba2b76f-a43f-4301-ae5b-dede731af9b3', 'ec26e476-0b39-4df6-8bcc-f7611d5300bd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:08 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316298840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eff95f0-bf8e-4cc7-8507-169dd0821d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume 9eff95f0-bf8e-4cc7-8507-169dd0821d91 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 1073741824 Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb413ecf-4926-4966-9e69-428375668990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e434355-5eae-4f19-8562-1d447d44ede2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8d38c7-42d5-4e05-957e-fa7e462b9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:09 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-1e434355-5eae-4f19-8562-1d447d44ede2 (1e434355-5eae-4f19-8562-1d447d44ede2): created successfully Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8d38c7-42d5-4e05-957e-fa7e462b9d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (1233b168-0fd2-4c0b-983d-c337ece56114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7eef9dea-0f08-4a55-940d-cbbf2f5af20a tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:09 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Deleted volume successfully. Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6dc7f201-0ae4-408e-a975-b87835baf8ff tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-a4165e0c-75e0-4ecb-932a-0a5cb08a7228-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:09 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 1073741824" returned: 0 in 0.692s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 Sep 23 00:32:09 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Flow 'volume_create_manager' (a4d6621d-4a67-4db5-a475-7b4906d1069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9fc4c-894a-4b1e-9683-b35ed3d6cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e9fc4c-894a-4b1e-9683-b35ed3d6cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-642749639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d0d875-65cc-4320-8765-1f95b895d558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad53527b83429b8066f2b4fbf63961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:10Z,use_quota=True,user_id='75f6043851f4432ab9745ae92ce60455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61b42d-f14e-4006-900d-1309d23be304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b61b42d-f14e-4006-900d-1309d23be304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ff49b2-1333-4d39-900d-635e4d94cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ff49b2-1333-4d39-900d-635e4d94cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d0d875-65cc-4320-8765-1f95b895d558', 'volume_name': 'volume-29d0d875-65cc-4320-8765-1f95b895d558', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da350dba-5860-482f-b4a6-e085131dc1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da350dba-5860-482f-b4a6-e085131dc1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42063af0-7e6b-4da6-9ec5-463e28724c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Volume 29d0d875-65cc-4320-8765-1f95b895d558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d0d875-65cc-4320-8765-1f95b895d558', 'volume_size': 1} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.608s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304073015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49527f5b2bd146dca55daaa781eaeec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:07Z,use_quota=True,user_id='bf08babe18a642c5a7d59a406dbce4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Creating volume 18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d1ab29-c6db-4795-a708-f9271905a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ce92cf-2c73-4dd3-950e-712ada0793f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:10 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 1073741824 Sep 23 00:32:10 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 (9eff95f0-bf8e-4cc7-8507-169dd0821d91): created successfully Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ce92cf-2c73-4dd3-950e-712ada0793f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (6908741b-5bd4-4dc5-9d15-418e27ceacdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bcc70762-83ac-40b6-bc79-8027da9d5b78 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:10 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 1073741824" returned: 0 in 0.759s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 Sep 23 00:32:11 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" returned: 0 in 0.283s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-642749639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d0d875-65cc-4320-8765-1f95b895d558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad53527b83429b8066f2b4fbf63961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:10Z,use_quota=True,user_id='75f6043851f4432ab9745ae92ce60455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Creating volume 29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:11 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fe361e-34a8-4517-a275-fa4a9311f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 1073741824 Sep 23 00:32:11 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2422bf4d-3f34-4ff7-9b12-f6549b1a73e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Volume volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 (18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3): created successfully Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2422bf4d-3f34-4ff7-9b12-f6549b1a73e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Flow 'volume_create_manager' (0ec963da-2aaa-41fa-a728-736f44df326a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-56f1ba7c-d3e3-4c96-9296-7b47aedb6d64 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created volume successfully. Sep 23 00:32:11 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 1073741824" returned: 0 in 0.682s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:12 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94d581-822f-4c0f-857b-59dd67445a8c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.669s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:12 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 Sep 23 00:32:12 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42063af0-7e6b-4da6-9ec5-463e28724c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d0d875-65cc-4320-8765-1f95b895d558', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56735def-3077-41d2-9b13-b4ff5b238c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Volume volume-29d0d875-65cc-4320-8765-1f95b895d558 (29d0d875-65cc-4320-8765-1f95b895d558): created successfully Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56735def-3077-41d2-9b13-b4ff5b238c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Flow 'volume_create_manager' (a4d6621d-4a67-4db5-a475-7b4906d1069b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-35e82efa-3a2c-4914-8b16-eb5cd030556e tempest-SnapshotDependencyTests-1590538957 None] Created volume successfully. Sep 23 00:32:13 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" returned: 0 in 0.614s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3 Sep 23 00:32:13 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Creating offline snapshot b9b9b4e1-6e6c-43df-8896-a3452a7d0487 of volume 29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2248ef34-3376-4e16-bc4b-ea3808d3b890]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3" released by "delete_volume" :: held 1.341s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['1ea475a6-de2c-4472-abe7-a255d2d783b7', 'd155a5a0-445a-49b5-8857-0b40b55a2b5b', 'de8fc326-6010-4817-8749-0420798352b6', '3ed0d7e2-8239-44cc-aae7-e19fea36197d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:13 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:13 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:14 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [req-846a7cde-6bbb-4a5a-a36f-d8bfecf123e8 req-0fdc95bf-a76e-4c8b-9b04-e8ebc8178164 tempest-TestInstancesWithCinderVolumes-838712812 None] Terminate volume connection completed successfully. Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [req-846a7cde-6bbb-4a5a-a36f-d8bfecf123e8 req-0fdc95bf-a76e-4c8b-9b04-e8ebc8178164 tempest-TestInstancesWithCinderVolumes-838712812 None] Deleting attachment 8f7d68af-8447-41ce-a6b5-2b35279d2602. {{(pid=87132) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:14 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.578s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 1G Sep 23 00:32:14 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-1b50c136-d63b-4b7c-9e8c-2aa30a42dfe1 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-18e73f95-6df7-4dbe-ba82-ef2a1a8e4ce3-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-9eff95f0-bf8e-4cc7-8507-169dd0821d91-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-9eff95f0-bf8e-4cc7-8507-169dd0821d91-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-9eff95f0-bf8e-4cc7-8507-169dd0821d91" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-9eff95f0-bf8e-4cc7-8507-169dd0821d91" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce3eba-0fb1-45f5-90fd-6467fb9d8570]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 1G" returned: 0 in 0.681s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d0d875-65cc-4320-8765-1f95b895d558 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d0d875-65cc-4320-8765-1f95b895d558 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:15 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 Sep 23 00:32:15 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d0d875-65cc-4320-8765-1f95b895d558 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 is being set with open permissions: ugo+rw Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91" returned: 0 in 0.649s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:15 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91 Sep 23 00:32:15 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9eff95f0-bf8e-4cc7-8507-169dd0821d91" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-9eff95f0-bf8e-4cc7-8507-169dd0821d91" released by "delete_volume" :: held 1.122s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:15 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info Sep 23 00:32:15 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['d06074dc-92fc-4b82-b762-fabc98b5821c', '6b494512-e821-4a5e-8d07-745862d34f9f', 'f105fdd5-1930-4ab2-9f7a-7c55a9b06309', '3f351a0e-b08d-43a7-ace8-a95c04238271'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:16 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info is being set with open permissions: ugo+rw Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-f937d945-b711-4fea-a860-ccc8aa93c5e0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-f937d945-b711-4fea-a860-ccc8aa93c5e0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:16 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info Sep 23 00:32:16 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "cinder-quobyte-f937d945-b711-4fea-a860-ccc8aa93c5e0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-f937d945-b711-4fea-a860-ccc8aa93c5e0" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46f514-55ff-41b5-9863-fa79c6ec8045]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9947c85f-ce95-4269-ae45-05a097d56bac tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-9eff95f0-bf8e-4cc7-8507-169dd0821d91-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:16 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 Sep 23 00:32:16 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.info" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8b12c0c0-51fd-466e-9290-8c1a243dd7b6 tempest-SnapshotDependencyTests-1590538957 None] Create snapshot completed successfully Sep 23 00:32:16 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0" returned: 0 in 0.462s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0 Sep 23 00:32:16 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-1e434355-5eae-4f19-8562-1d447d44ede2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-1e434355-5eae-4f19-8562-1d447d44ede2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-1e434355-5eae-4f19-8562-1d447d44ede2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-1e434355-5eae-4f19-8562-1d447d44ede2" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d1b3f-4abd-417e-a5dc-208dc02cb8e4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 Sep 23 00:32:17 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f937d945-b711-4fea-a860-ccc8aa93c5e0" returned: 0 in 0.413s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-quobyte-f937d945-b711-4fea-a860-ccc8aa93c5e0" released by "delete_volume" :: held 0.936s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:17 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369931842-1100422140 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369931842-1100422140, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:17 devstack cinder-volume[87132]: WARNING cinder.quota [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369931842-1100422140 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1369931842-1100422140, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Created reservations ['a8e8bd72-308a-459e-ae8e-fbcd6ae396e6', 'a40155ac-4cc5-4e2c-9c5a-993b9e3d77d7', 'ffe85a0d-4366-4d69-9469-2eaf3d396e01', '6f8c59f1-dab2-4881-a02b-d4fadb7c0002'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:17 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2" returned: 0 in 0.572s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2 Sep 23 00:32:17 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Flow 'volume_create_manager' (e2b07c23-4664-4b71-9663-18fcd14a4beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2af8bfc-d99c-4186-b04c-38b7b2dc9e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2af8bfc-d99c-4186-b04c-38b7b2dc9e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca65f24d-c693-4052-8875-d0b907555e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad53527b83429b8066f2b4fbf63961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9b9b4e1-6e6c-43df-8896-a3452a7d0487,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:18Z,use_quota=True,user_id='75f6043851f4432ab9745ae92ce60455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44741a5-8d4d-409d-99bd-427002eef7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44741a5-8d4d-409d-99bd-427002eef7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1622bcb2-6dd8-4a3d-9d53-ad678d40e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1622bcb2-6dd8-4a3d-9d53-ad678d40e80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca65f24d-c693-4052-8875-d0b907555e12', 'volume_name': 'volume-ca65f24d-c693-4052-8875-d0b907555e12', 'volume_size': 1, 'snapshot_id': 'b9b9b4e1-6e6c-43df-8896-a3452a7d0487'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fe0e5f-46e0-4476-b8c2-5136f2a5c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24fe0e5f-46e0-4476-b8c2-5136f2a5c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fecb8a-06dc-481c-949f-c7370b87f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Volume ca65f24d-c693-4052-8875-d0b907555e12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca65f24d-c693-4052-8875-d0b907555e12', 'volume_size': 1, 'snapshot_id': 'b9b9b4e1-6e6c-43df-8896-a3452a7d0487'} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Deleted volume successfully. Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-ca65f24d-c693-4052-8875-d0b907555e12" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-ca65f24d-c693-4052-8875-d0b907555e12" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Creating volume ca65f24d-c693-4052-8875-d0b907555e12 from snapshot b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6cab10b5-32c8-4431-8b97-2761613df7ca tempest-TestInstancesWithCinderVolumes-838712812 None] Lock "cinder-f937d945-b711-4fea-a860-ccc8aa93c5e0-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] snapshot: b9b9b4e1-6e6c-43df-8896-a3452a7d0487, volume: ca65f24d-c693-4052-8875-d0b907555e12, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:32:18 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1e434355-5eae-4f19-8562-1d447d44ede2" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-1e434355-5eae-4f19-8562-1d447d44ede2" released by "delete_volume" :: held 1.012s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf1797-ffd1-443e-8309-bd4c203c58fe]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['5ee25e86-3db7-419e-a4e8-dff64a3963a2', '4ee74bb7-b4cb-435d-9178-2c7641a14c2f', 'a3d66dd9-82ab-4902-bd59-d03e2c7a9d99', '3e5d9006-4b93-44c3-b5a4-d5e6b92c7785'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:18 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:18 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d0d875-65cc-4320-8765-1f95b895d558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0953c-0800-45d2-9262-b3b17202cf45]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86db6be9-4ee2-48f3-80f4-ea824ab5f9ce tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-1e434355-5eae-4f19-8562-1d447d44ede2-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:18 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:18 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.498s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 Sep 23 00:32:19 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-5c45ad73-5ef1-46c6-bdb3-2e489f390659-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-5c45ad73-5ef1-46c6-bdb3-2e489f390659-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-5c45ad73-5ef1-46c6-bdb3-2e489f390659" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-5c45ad73-5ef1-46c6-bdb3-2e489f390659" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b785de57-6660-4deb-b5b1-a90a56dd804a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 Sep 23 00:32:19 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659" returned: 0 in 0.718s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659 Sep 23 00:32:20 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c45ad73-5ef1-46c6-bdb3-2e489f390659" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-5c45ad73-5ef1-46c6-bdb3-2e489f390659" released by "delete_volume" :: held 1.327s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['fe22ac98-b5e4-414f-889d-ef15ab6849f2', '86430d55-330b-4660-9cfe-be8dc9009c66', 'f1e878cd-bb82-42a0-8b01-e4d8f600020a', 'ac49ec62-57fc-447a-97e2-1e708b48bab0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:21 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-1d12aed0-57d8-404d-8431-7d2874a92032-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-1d12aed0-57d8-404d-8431-7d2874a92032-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:22 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.838s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-1d12aed0-57d8-404d-8431-7d2874a92032" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-1d12aed0-57d8-404d-8431-7d2874a92032" acquired by "delete_volume" :: waited 0.073s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b1f9a89c-d38b-4940-be6f-efbe10951c58 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-5c45ad73-5ef1-46c6-bdb3-2e489f390659-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b46e9e-5ffb-4190-b63e-de3ea100badc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:22 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 Sep 23 00:32:22 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032" returned: 0 in 0.968s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:23 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032 Sep 23 00:32:23 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1d12aed0-57d8-404d-8431-7d2874a92032" returned: 0 in 0.533s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-1d12aed0-57d8-404d-8431-7d2874a92032" released by "delete_volume" :: held 1.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['6b9130e1-8571-4988-99a8-d10b5430b154', 'e885aed4-d0a6-4b11-82c8-8aa4a3edcf64', 'e172ed8f-44f7-4d4c-a095-ca153673aafa', '647ae965-8c56-4671-9f9a-600b32e578a7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-fe075dc2-85d9-4300-a993-ea8f7c3928cd-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:24 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-fe075dc2-85d9-4300-a993-ea8f7c3928cd-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "cinder-quobyte-fe075dc2-85d9-4300-a993-ea8f7c3928cd" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-fe075dc2-85d9-4300-a993-ea8f7c3928cd" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f88483-e7db-4569-b18b-01f80d5c2df3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd Sep 23 00:32:25 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.815s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:25 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3aeded5d-7b6b-42e2-8e4c-a1fe277ce07e tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-1d12aed0-57d8-404d-8431-7d2874a92032-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:25 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd" returned: 0 in 1.134s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd Sep 23 00:32:25 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fe075dc2-85d9-4300-a993-ea8f7c3928cd" returned: 0 in 0.642s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-quobyte-fe075dc2-85d9-4300-a993-ea8f7c3928cd" released by "delete_volume" :: held 1.931s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Created reservations ['822e7e47-acb5-4ed8-bafc-b85868f270f7', 'c14437c3-bb3d-4f00-8d65-e6bf969c0f66', 'dc9aa29e-db02-463d-9daf-046da5f50a82', '3415818d-c456-4e75-b92e-472608445966'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:27 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:27 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Deleted volume successfully. Sep 23 00:32:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa1c3e30-7a9a-4135-a85e-293171d8a822 tempest-CreateVolumesFromSourceVolumeTest-1566646970 None] Lock "cinder-fe075dc2-85d9-4300-a993-ea8f7c3928cd-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12" returned: 0 in 10.165s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558, size 1024.00 MB, duration 10.17 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:29 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Converted 1024.00 MB image at 100.71 MB/s Sep 23 00:32:29 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 is being set with open permissions: ugo+rw Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 Sep 23 00:32:29 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" released by "_copy_volume_from_snapshot" :: held 11.672s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-ca65f24d-c693-4052-8875-d0b907555e12" released by "_create_volume_from_snapshot" :: held 11.764s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.788s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fecb8a-06dc-481c-949f-c7370b87f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca65f24d-c693-4052-8875-d0b907555e12', 'volume_size': 1, 'snapshot_id': 'b9b9b4e1-6e6c-43df-8896-a3452a7d0487'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015b0cc8-780a-4c3e-a48a-560b223bdba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:29 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Volume volume-ca65f24d-c693-4052-8875-d0b907555e12 (ca65f24d-c693-4052-8875-d0b907555e12): created successfully Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015b0cc8-780a-4c3e-a48a-560b223bdba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:29 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Flow 'volume_create_manager' (e2b07c23-4664-4b71-9663-18fcd14a4beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e794cf18-1c1b-4ad3-9ec7-7230af71e293 tempest-SnapshotDependencyTests-1590538957 None] Created volume successfully. Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Deleting offline snapshot b9b9b4e1-6e6c-43df-8896-a3452a7d0487 of volume 29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] snapshot_file for this snap is: volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43da3dc-a11b-4472-b8c5-c2cbd6ef5e51]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:30 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.487s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d0d875-65cc-4320-8765-1f95b895d558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[65797159-eeef-4cda-9f7d-6063eced52b2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:31 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.629s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:31 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487 Sep 23 00:32:32 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558.b9b9b4e1-6e6c-43df-8896-a3452a7d0487" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-b9b9b4e1-6e6c-43df-8896-a3452a7d0487" released by "_delete_snapshot" :: held 2.120s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" released by "delete_snapshot" :: held 2.150s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Created reservations ['fe03bc87-cd21-4840-b092-3f2416b4e246', '93cd037e-95ef-4511-8ed1-50fca44203c7', '740a7b70-a3d6-470d-9f3d-f94b4b892bcc', '680222cf-6c85-4eca-8c46-6b0a95bc41da'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Delete snapshot completed successfully. Sep 23 00:32:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dacc0618-7467-4401-ab43-3a164e052e27 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-b9b9b4e1-6e6c-43df-8896-a3452a7d0487-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-29d0d875-65cc-4320-8765-1f95b895d558-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-29d0d875-65cc-4320-8765-1f95b895d558-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098de93-6486-45d8-8281-9f6b62a3d2f5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:33 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:33 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.434s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558 Sep 23 00:32:34 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-29d0d875-65cc-4320-8765-1f95b895d558" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-29d0d875-65cc-4320-8765-1f95b895d558" released by "delete_volume" :: held 0.859s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Created reservations ['5277701c-ff11-4fe4-9f5c-b5cae8c8a85a', 'c9e1058b-0268-47b4-af37-b083e6bf58ff', '0830aa0c-d25a-441f-acdd-2f25ae0b41cc', '08582310-e0f7-4831-9796-cc807febcf60'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:34 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-ca65f24d-c693-4052-8875-d0b907555e12-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-ca65f24d-c693-4052-8875-d0b907555e12-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fd51af-e84d-4e9a-af64-5ae090911146]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 Sep 23 00:32:35 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.482s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Deleted volume successfully. Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-590dafd1-a7a9-43d9-ad72-c09f26cd3032 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-29d0d875-65cc-4320-8765-1f95b895d558-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:35 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12" returned: 0 in 0.534s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12 Sep 23 00:32:35 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ca65f24d-c693-4052-8875-d0b907555e12" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-quobyte-ca65f24d-c693-4052-8875-d0b907555e12" released by "delete_volume" :: held 0.954s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Created reservations ['8ce6f718-39c1-4328-affc-be5043943bb4', '1714b109-1e79-4cfd-b14a-13a7b22cfd7c', '89298608-7868-4c27-af31-c061f76541f3', '0ef83af2-a2d2-43c5-b616-77aa5381dbd1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:36 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Deleted volume successfully. Sep 23 00:32:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-48f41419-220b-4e55-a00d-1f2a1b39d153 tempest-SnapshotDependencyTests-1590538957 None] Lock "cinder-ca65f24d-c693-4052-8875-d0b907555e12-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (2d02e83b-cab5-4049-9c27-0d575c11715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fc8d7-77ac-47ee-9c05-8300fbf4058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8fc8d7-77ac-47ee-9c05-8300fbf4058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435236704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5f9993-8bc8-4296-a211-fd229ada897c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:39Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d335e47f-b5ad-4a17-889e-35b0a9ceb7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d335e47f-b5ad-4a17-889e-35b0a9ceb7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673366b-8e44-471c-b325-4d1dfa18412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673366b-8e44-471c-b325-4d1dfa18412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5f9993-8bc8-4296-a211-fd229ada897c', 'volume_name': 'volume-da5f9993-8bc8-4296-a211-fd229ada897c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04a5331-c7b4-42f8-9096-ba2dfa2cdec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04a5331-c7b4-42f8-9096-ba2dfa2cdec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02441c6-9054-4f64-aab7-03e482c41d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Volume da5f9993-8bc8-4296-a211-fd229ada897c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5f9993-8bc8-4296-a211-fd229ada897c', 'volume_size': 1} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435236704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5f9993-8bc8-4296-a211-fd229ada897c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:39Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Creating volume da5f9993-8bc8-4296-a211-fd229ada897c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:39 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c 1073741824 Sep 23 00:32:39 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:39 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c 1073741824" returned: 0 in 0.836s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c Sep 23 00:32:40 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:40 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=180,cinder:SELECT=136,cinder:DELETE=9,cinder:INSERT=47 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02441c6-9054-4f64-aab7-03e482c41d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5f9993-8bc8-4296-a211-fd229ada897c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306cd732-ff94-4943-ba86-5c2a580a65a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=138,cinder:INSERT=41,cinder:UPDATE=186,cinder:DELETE=19 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Volume volume-da5f9993-8bc8-4296-a211-fd229ada897c (da5f9993-8bc8-4296-a211-fd229ada897c): created successfully Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306cd732-ff94-4943-ba86-5c2a580a65a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (2d02e83b-cab5-4049-9c27-0d575c11715c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f45c849-b931-4c4b-9b51-db56fe0bfd3f tempest-ProjectReaderTests-1062546423 None] Created volume successfully. Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (baaedb40-7467-4a33-b4f5-8022e0a8349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa81abf3-8d2c-438b-b90f-2126f4cd77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa81abf3-8d2c-438b-b90f-2126f4cd77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609080881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dd8a71-0457-4f49-8047-a1fd30a921d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:41Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78da7da-b5a2-43f3-be64-a4dd779c05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78da7da-b5a2-43f3-be64-a4dd779c05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60e13bc-5f92-4ead-b635-017c85fcc40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60e13bc-5f92-4ead-b635-017c85fcc40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62dd8a71-0457-4f49-8047-a1fd30a921d9', 'volume_name': 'volume-62dd8a71-0457-4f49-8047-a1fd30a921d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079a73d0-8154-4ea1-8acf-18a8ce749bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079a73d0-8154-4ea1-8acf-18a8ce749bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd8d037-8bc2-4ec5-bfab-61955debbc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Volume 62dd8a71-0457-4f49-8047-a1fd30a921d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62dd8a71-0457-4f49-8047-a1fd30a921d9', 'volume_size': 1} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609080881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dd8a71-0457-4f49-8047-a1fd30a921d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:41Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Creating volume 62dd8a71-0457-4f49-8047-a1fd30a921d9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:40 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 1073741824 Sep 23 00:32:40 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (39e6aac8-de3a-4b31-a6db-ab21f647a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfdd138-bc3a-4ad2-bfb6-7fa7fddc4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-da5f9993-8bc8-4296-a211-fd229ada897c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfdd138-bc3a-4ad2-bfb6-7fa7fddc4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659854173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced7a67c-a5ba-4707-86ac-abad7aec734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac90b3-8d7f-4eab-b824-f93c662e3fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaac90b3-8d7f-4eab-b824-f93c662e3fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea7463f-9de3-4b98-9fb4-d9d96958a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea7463f-9de3-4b98-9fb4-d9d96958a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced7a67c-a5ba-4707-86ac-abad7aec734a', 'volume_name': 'volume-ced7a67c-a5ba-4707-86ac-abad7aec734a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71582696-29b5-4514-acc4-6af8cc0d4022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71582696-29b5-4514-acc4-6af8cc0d4022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0903e0-3bdf-40e9-a3cc-83eccbdea1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:41 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Volume ced7a67c-a5ba-4707-86ac-abad7aec734a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced7a67c-a5ba-4707-86ac-abad7aec734a', 'volume_size': 1} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-da5f9993-8bc8-4296-a211-fd229ada897c-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-quobyte-da5f9993-8bc8-4296-a211-fd229ada897c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:41 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 1073741824" returned: 0 in 1.014s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-da5f9993-8bc8-4296-a211-fd229ada897c" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5953b-fbfb-4b1d-b40d-e4f2d99af80c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:42 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (73a17a20-2625-49be-b199-3753a287ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:42 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02e4ad9-3ad2-44d6-92ed-837ae8f3475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02e4ad9-3ad2-44d6-92ed-837ae8f3475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-512510957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e17798-d2d3-4129-9b9d-ef1314ee7e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e17798-d2d3-4129-9b9d-ef1314ee7e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c Sep 23 00:32:42 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd26203-5957-4194-ba7f-316ba932a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd26203-5957-4194-ba7f-316ba932a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0', 'volume_name': 'volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118bb0d5-90ac-48d7-9eba-86f897103c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118bb0d5-90ac-48d7-9eba-86f897103c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67db30a6-d551-4a0f-b46d-d29442721f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Volume 0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0', 'volume_size': 1} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:42 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659854173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced7a67c-a5ba-4707-86ac-abad7aec734a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Creating volume ced7a67c-a5ba-4707-86ac-abad7aec734a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a 1073741824 Sep 23 00:32:42 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd8d037-8bc2-4ec5-bfab-61955debbc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62dd8a71-0457-4f49-8047-a1fd30a921d9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbffdea-ae3e-4b87-8b93-dd98ee556c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Volume volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 (62dd8a71-0457-4f49-8047-a1fd30a921d9): created successfully Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbffdea-ae3e-4b87-8b93-dd98ee556c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:42 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c Sep 23 00:32:42 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (baaedb40-7467-4a33-b4f5-8022e0a8349b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37ba5083-33b4-4dd2-bec1-a9d814d39d51 tempest-CreateVolumesFromImageTest-2085635629 None] Created volume successfully. Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (e75b4d8f-c601-4d12-9df0-56f4af735782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:42 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336eb502-7bcd-4119-990c-d03705b8f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-da5f9993-8bc8-4296-a211-fd229ada897c" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336eb502-7bcd-4119-990c-d03705b8f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866872929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:43Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c66ee-b385-49ac-8786-d0315479b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c66ee-b385-49ac-8786-d0315479b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac3bd86-c76b-458d-aab9-79dc744edec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac3bd86-c76b-458d-aab9-79dc744edec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952', 'volume_name': 'volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daf2d5d-04a3-4ca0-959e-27d14fd96c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daf2d5d-04a3-4ca0-959e-27d14fd96c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316d353b-9776-44dc-96dc-56ee8a23943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Volume 9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952', 'volume_size': 1} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-da5f9993-8bc8-4296-a211-fd229ada897c" released by "delete_volume" :: held 1.106s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a 1073741824" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a Sep 23 00:32:43 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Created reservations ['0bb67b37-b10c-448d-9a82-6e135d6d64e0', '7aaf3983-c13e-43b2-8f3c-d9dcb591c745', 'baec9c46-d0f3-4fcb-89e2-00af10cb7a36', '2f92758c-820b-47f1-a2b8-ab0edf960764'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:43 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a" returned: 0 in 0.454s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.368s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-512510957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:42Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Creating volume 0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 1073741824 Sep 23 00:32:43 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0903e0-3bdf-40e9-a3cc-83eccbdea1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced7a67c-a5ba-4707-86ac-abad7aec734a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c679899-e9b4-4def-b404-b15327eeb3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Volume volume-ced7a67c-a5ba-4707-86ac-abad7aec734a (ced7a67c-a5ba-4707-86ac-abad7aec734a): created successfully Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c679899-e9b4-4def-b404-b15327eeb3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (39e6aac8-de3a-4b31-a6db-ab21f647a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (b2265a80-9bad-4ee1-a7e0-18354ac1e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4972be01-0f25-47b4-bb09-0a7753a0eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.411s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4972be01-0f25-47b4-bb09-0a7753a0eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1069658439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4428cd-a07a-4541-b4bc-4d60474c2226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:44Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ee5f80-feb9-45f3-ae85-b06b9742fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ee5f80-feb9-45f3-ae85-b06b9742fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7619c31d-54e2-4530-acdd-9b8dcb6b007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7619c31d-54e2-4530-acdd-9b8dcb6b007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4428cd-a07a-4541-b4bc-4d60474c2226', 'volume_name': 'volume-2c4428cd-a07a-4541-b4bc-4d60474c2226', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3eb9cca-c6c9-4a12-ae91-98da802dba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3eb9cca-c6c9-4a12-ae91-98da802dba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea56f1-03ac-453b-bf19-574599cd9b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Volume 2c4428cd-a07a-4541-b4bc-4d60474c2226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4428cd-a07a-4541-b4bc-4d60474c2226', 'volume_size': 1} Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Deleted volume successfully. Sep 23 00:32:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bab6d199-8700-4095-845a-05d452b5285e tempest-CreateVolumesFromImageTest-2085635629 None] Created volume successfully. Sep 23 00:32:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ee4344e5-ec42-4744-8bd3-ca8b689edeb9 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-da5f9993-8bc8-4296-a211-fd229ada897c-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:44 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 1073741824" returned: 0 in 0.701s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:44 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 Sep 23 00:32:44 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (03674722-061c-4b23-bb26-b540304abd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2da074-a094-4c88-9836-3af84771e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2da074-a094-4c88-9836-3af84771e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717611714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d773a-12da-45b4-8578-118f526b32c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:45Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8d4720-98d1-40f6-b743-2351344bfb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8d4720-98d1-40f6-b743-2351344bfb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a9b5c6-39c0-4629-b9c0-9ef70eb37bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a9b5c6-39c0-4629-b9c0-9ef70eb37bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275d773a-12da-45b4-8578-118f526b32c6', 'volume_name': 'volume-275d773a-12da-45b4-8578-118f526b32c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6287818-9508-4467-8d2a-faa21859b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6287818-9508-4467-8d2a-faa21859b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1573bc01-5c05-42e8-852d-573660ef6621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Volume 275d773a-12da-45b4-8578-118f526b32c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275d773a-12da-45b4-8578-118f526b32c6', 'volume_size': 1} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" returned: 0 in 0.508s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866872929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:43Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Creating volume 9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:44 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 1073741824 Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67db30a6-d551-4a0f-b46d-d29442721f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138e179-3399-402a-bdb3-75a04332fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Volume volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 (0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0): created successfully Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138e179-3399-402a-bdb3-75a04332fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (73a17a20-2625-49be-b199-3753a287ec30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-904ad76f-9344-43cf-8f31-3526420028b8 tempest-CreateVolumesFromImageTest-2085635629 None] Created volume successfully. Sep 23 00:32:45 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 1073741824" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 Sep 23 00:32:45 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1069658439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4428cd-a07a-4541-b4bc-4d60474c2226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0301de6c564741cdb0198761d57d0253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:44Z,use_quota=True,user_id='90f21b2ab40840fdbaabe2691a0f4a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Creating volume 2c4428cd-a07a-4541-b4bc-4d60474c2226 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316d353b-9776-44dc-96dc-56ee8a23943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 1073741824 Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbea551-e991-44e7-9c70-7d000ae0f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:45 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Volume volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 (9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952): created successfully Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cbea551-e991-44e7-9c70-7d000ae0f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (e75b4d8f-c601-4d12-9df0-56f4af735782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e76dc299-b28c-4e2a-8d4b-304d4f6d4f62 tempest-CreateVolumesFromImageTest-2085635629 None] Created volume successfully. Sep 23 00:32:46 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 1073741824" returned: 0 in 0.593s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 Sep 23 00:32:46 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717611714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d773a-12da-45b4-8578-118f526b32c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:45Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Creating volume 275d773a-12da-45b4-8578-118f526b32c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:46 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea56f1-03ac-453b-bf19-574599cd9b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4428cd-a07a-4541-b4bc-4d60474c2226', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 1073741824 Sep 23 00:32:46 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d6b4c7-22f3-4ea6-80f1-21dd9045f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Volume volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 (2c4428cd-a07a-4541-b4bc-4d60474c2226): created successfully Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d6b4c7-22f3-4ea6-80f1-21dd9045f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Flow 'volume_create_manager' (b2265a80-9bad-4ee1-a7e0-18354ac1e293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c7e415c9-2a85-490f-8b7c-5f693ddddebb tempest-CreateVolumesFromImageTest-2085635629 None] Created volume successfully. Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-2c4428cd-a07a-4541-b4bc-4d60474c2226-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-2c4428cd-a07a-4541-b4bc-4d60474c2226-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-quobyte-2c4428cd-a07a-4541-b4bc-4d60474c2226" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-2c4428cd-a07a-4541-b4bc-4d60474c2226" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83165e0c-a919-4f65-9d0c-6b6fb8dfe2dd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 Sep 23 00:32:47 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 1073741824" returned: 0 in 0.789s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 Sep 23 00:32:47 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226 Sep 23 00:32:47 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1573bc01-5c05-42e8-852d-573660ef6621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275d773a-12da-45b4-8578-118f526b32c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a06f7e1-b908-4d32-bacd-24a0b0a18974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Volume volume-275d773a-12da-45b4-8578-118f526b32c6 (275d773a-12da-45b4-8578-118f526b32c6): created successfully Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a06f7e1-b908-4d32-bacd-24a0b0a18974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (03674722-061c-4b23-bb26-b540304abd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0bd1f358-348c-4b29-8a79-41a827a0686e tempest-ProjectReaderTests-1062546423 None] Created volume successfully. Sep 23 00:32:48 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-2c4428cd-a07a-4541-b4bc-4d60474c2226" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-2c4428cd-a07a-4541-b4bc-4d60474c2226" released by "delete_volume" :: held 0.881s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Created reservations ['56186dd4-7377-4425-b58f-ac601fb9f9b8', 'ab51133c-b90c-4150-adcf-6231f63f1696', '0e736a97-e4f8-4c2b-b56a-b0539b3545f7', 'b60d24b5-31e5-4549-ab4c-d4d0615a8544'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:48 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-quobyte-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[845354bf-6565-4a77-a5a2-f799ffda7fb6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Deleted volume successfully. Sep 23 00:32:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a1959abe-e13c-4dee-a68c-6f3e821b030a tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-2c4428cd-a07a-4541-b4bc-4d60474c2226-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:48 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 Sep 23 00:32:48 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-275d773a-12da-45b4-8578-118f526b32c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-275d773a-12da-45b4-8578-118f526b32c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-quobyte-275d773a-12da-45b4-8578-118f526b32c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-275d773a-12da-45b4-8578-118f526b32c6" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb5e42-56c5-4d8c-97fd-c862135f50f9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952 Sep 23 00:32:49 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 Sep 23 00:32:49 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" returned: 0 in 0.365s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952" released by "delete_volume" :: held 0.903s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Created reservations ['fd5d405f-761b-4fa6-a489-a9dea3f92b12', '5bbfcb87-d17c-46c4-a7a4-61523a57efe1', '53cf521d-0364-4fc0-bfec-ff8fe8fc5e05', '3faa0721-53a4-4cd4-add7-cb984137004f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:49 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6" returned: 0 in 0.604s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6 Sep 23 00:32:49 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:49 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:49 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-275d773a-12da-45b4-8578-118f526b32c6" returned: 0 in 0.526s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-275d773a-12da-45b4-8578-118f526b32c6" released by "delete_volume" :: held 1.207s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:50 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Created reservations ['d21a3ecb-e460-4022-9550-f5607ca098a7', 'b4d69579-bdf8-4bc8-9adb-350b981efb3a', '030d177f-5b06-4dbb-b783-6d545dd8308e', '0549b4b8-ec60-44a7-a50d-18338aa5944d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Deleted volume successfully. Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e35695f2-452c-4897-a087-a139c0ecedcc tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-9f3e17f9-26b3-4f8d-a0fc-88cbd8f61952-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:50 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.338s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Deleted volume successfully. Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-682db535-e23e-4687-98e4-a0c6f6ff6561 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-275d773a-12da-45b4-8578-118f526b32c6-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-quobyte-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c4f9b-dcb3-40a5-b25d-b6ccd250475c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 Sep 23 00:32:51 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0 Sep 23 00:32:51 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:52 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (adfd041e-379d-4532-a858-bbf4925f50ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d707676-8ce1-46f7-8a8e-271d383ab36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d707676-8ce1-46f7-8a8e-271d383ab36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296315142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf88115-913f-4bf8-b537-d130c92b17db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:52Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1983c6e1-fed0-4670-bbcb-66c1b6f920f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1983c6e1-fed0-4670-bbcb-66c1b6f920f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c46526-680b-4dbd-8ab5-a05751395794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c46526-680b-4dbd-8ab5-a05751395794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf88115-913f-4bf8-b537-d130c92b17db', 'volume_name': 'volume-6bf88115-913f-4bf8-b537-d130c92b17db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a04612-15f5-488f-b80a-e9ef4d1823f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a04612-15f5-488f-b80a-e9ef4d1823f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f532ce-b7de-4ec4-be52-b1f628de9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Volume 6bf88115-913f-4bf8-b537-d130c92b17db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf88115-913f-4bf8-b537-d130c92b17db', 'volume_size': 1} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296315142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf88115-913f-4bf8-b537-d130c92b17db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:52Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Creating volume 6bf88115-913f-4bf8-b537-d130c92b17db {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:52 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0" released by "delete_volume" :: held 1.251s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db 1073741824 Sep 23 00:32:52 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Created reservations ['9511bb4c-b807-4fde-b813-0c3e4ff02c7c', '04b14a48-23ce-44ab-803a-c9d04dace4ab', '8b4cf610-3aac-4344-86db-73c39ae974c8', '313ba431-a234-4cd9-80d7-b6a8fb733954'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:52 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db 1073741824" returned: 0 in 0.619s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.406s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Deleted volume successfully. Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b38402a3-43de-4868-85ba-b7e150e58aa6 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-0ce56157-dd0a-45b3-94b4-0c6c8ef7fab0-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db Sep 23 00:32:53 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f532ce-b7de-4ec4-be52-b1f628de9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf88115-913f-4bf8-b537-d130c92b17db', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2645eaf6-f332-40a5-b722-eb580514f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Volume volume-6bf88115-913f-4bf8-b537-d130c92b17db (6bf88115-913f-4bf8-b537-d130c92b17db): created successfully Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2645eaf6-f332-40a5-b722-eb580514f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (adfd041e-379d-4532-a858-bbf4925f50ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-ced7a67c-a5ba-4707-86ac-abad7aec734a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e416d9e1-1c1f-4395-93a6-640f3e020cc3 tempest-ProjectReaderTests-1062546423 None] Created volume successfully. Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-ced7a67c-a5ba-4707-86ac-abad7aec734a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-quobyte-ced7a67c-a5ba-4707-86ac-abad7aec734a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-ced7a67c-a5ba-4707-86ac-abad7aec734a" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03702c1-2de8-4eb4-84ce-3deddc13fc28]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a Sep 23 00:32:53 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a Sep 23 00:32:54 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-6bf88115-913f-4bf8-b537-d130c92b17db-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-6bf88115-913f-4bf8-b537-d130c92b17db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-quobyte-6bf88115-913f-4bf8-b537-d130c92b17db" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-6bf88115-913f-4bf8-b537-d130c92b17db" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:54 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ced7a67c-a5ba-4707-86ac-abad7aec734a" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a0d45d-eaba-4e73-a55e-bdc65c104193]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-ced7a67c-a5ba-4707-86ac-abad7aec734a" released by "delete_volume" :: held 1.039s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Created reservations ['5c3e739c-d16e-406b-b6c2-184d59d203f5', '9f7ce3dd-33f3-41b8-850f-971c16c8e5f3', '1d577b0d-84ec-426e-896f-b5180a2816cd', 'b7e96df5-3097-4bfd-a7e3-f25772269e20'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:54 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db Sep 23 00:32:54 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:54 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db" returned: 0 in 0.504s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db Sep 23 00:32:55 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Deleted volume successfully. Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2efe04a5-96f1-4602-af60-9644f1e88608 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-ced7a67c-a5ba-4707-86ac-abad7aec734a-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:55 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6bf88115-913f-4bf8-b537-d130c92b17db" returned: 0 in 0.394s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-6bf88115-913f-4bf8-b537-d130c92b17db" released by "delete_volume" :: held 0.989s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Created reservations ['b7f8952f-34a7-4a73-8bf4-4394ee9261f4', '6ce7a1ef-3541-43b7-abf9-71847a5e9931', '280995e4-378b-4b92-b38c-2fec4b2f80a6', '57d518cc-bca5-49c3-909f-ab1a41a959f1'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:55 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-62dd8a71-0457-4f49-8047-a1fd30a921d9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-62dd8a71-0457-4f49-8047-a1fd30a921d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "cinder-quobyte-62dd8a71-0457-4f49-8047-a1fd30a921d9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-62dd8a71-0457-4f49-8047-a1fd30a921d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ec38a6-9888-4f25-87d9-f94498407e7e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 Sep 23 00:32:55 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Deleted volume successfully. Sep 23 00:32:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-87fa76d2-742f-403a-95df-bc4c93b64322 tempest-ProjectReaderTests-1062546423 None] Lock "cinder-6bf88115-913f-4bf8-b537-d130c92b17db-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:56 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9 Sep 23 00:32:56 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-62dd8a71-0457-4f49-8047-a1fd30a921d9" returned: 0 in 0.318s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-quobyte-62dd8a71-0457-4f49-8047-a1fd30a921d9" released by "delete_volume" :: held 0.817s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Created reservations ['5e248df8-74d1-4718-a643-6e185b97e64b', 'ce792c11-f047-420f-93ec-fe4dea67e780', 'b7f8b651-c864-47f1-9c3f-bf91ba05246b', 'e46f79eb-13b5-4055-bf23-4fcc17e421ad'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:32:56 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Deleted volume successfully. Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-33aa4a80-180c-409f-b298-c405688b4864 tempest-CreateVolumesFromImageTest-2085635629 None] Lock "cinder-62dd8a71-0457-4f49-8047-a1fd30a921d9-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (1a472c86-73df-4ff9-84e5-21db9d65f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078dd601-d2aa-4315-8ece-18512591910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078dd601-d2aa-4315-8ece-18512591910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255227975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923b7599-5629-4032-85a7-5a62b299ae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:57Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d5461-d938-436d-99a7-2005a35440ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d5461-d938-436d-99a7-2005a35440ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86304125-fb93-43d5-baba-3f361d43af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86304125-fb93-43d5-baba-3f361d43af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923b7599-5629-4032-85a7-5a62b299ae4b', 'volume_name': 'volume-923b7599-5629-4032-85a7-5a62b299ae4b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3c9f94-137e-4b82-b633-9dd7f87a9c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3c9f94-137e-4b82-b633-9dd7f87a9c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569687d-7e15-4e3f-984f-eeb95e4aa46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Volume 923b7599-5629-4032-85a7-5a62b299ae4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923b7599-5629-4032-85a7-5a62b299ae4b', 'volume_size': 1} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255227975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923b7599-5629-4032-85a7-5a62b299ae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e12f85e511478b9202d7a01857f5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:57Z,use_quota=True,user_id='b6aa7282b2244edba841adefc1316361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Creating volume 923b7599-5629-4032-85a7-5a62b299ae4b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:57 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b 1073741824 Sep 23 00:32:57 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b 1073741824" returned: 0 in 0.609s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b Sep 23 00:32:58 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4569687d-7e15-4e3f-984f-eeb95e4aa46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923b7599-5629-4032-85a7-5a62b299ae4b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add0820f-85e1-4f73-b302-8b581b42ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Volume volume-923b7599-5629-4032-85a7-5a62b299ae4b (923b7599-5629-4032-85a7-5a62b299ae4b): created successfully Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add0820f-85e1-4f73-b302-8b581b42ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Flow 'volume_create_manager' (1a472c86-73df-4ff9-84e5-21db9d65f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0503913c-c209-4987-8a2c-4916ac3d5b8b tempest-ProjectReaderTests-1062546423 None] Created volume successfully. Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-923b7599-5629-4032-85a7-5a62b299ae4b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "cinder-923b7599-5629-4032-85a7-5a62b299ae4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Acquiring lock "cinder-quobyte-923b7599-5629-4032-85a7-5a62b299ae4b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-923b7599-5629-4032-85a7-5a62b299ae4b" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f8537-e2f4-498a-9082-1521d7dae2d4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b Sep 23 00:32:59 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b Sep 23 00:33:00 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-923b7599-5629-4032-85a7-5a62b299ae4b" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "cinder-quobyte-923b7599-5629-4032-85a7-5a62b299ae4b" released by "delete_volume" :: held 0.864s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Created reservations ['e5234027-7a6d-4a88-9789-377ecacf5aed', '77e0b54e-6131-48af-9780-2cbca16ab896', '73d9b670-0bf8-49c8-a1af-916cd1a4d377', 'aa239d17-1bb7-40e5-b327-e10df63a16a5'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:00 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Deleted volume successfully. Sep 23 00:33:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-444ecf6f-d340-4043-a314-26b4833cf26a tempest-ProjectReaderTests-1062546423 None] Lock "cinder-923b7599-5629-4032-85a7-5a62b299ae4b-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Flow 'volume_create_manager' (e85f36e5-52d0-43ce-b798-12f5deedebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a817d-127a-4ba4-9627-e0264f11feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171a817d-127a-4ba4-9627-e0264f11feef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf729b-3664-49c6-acfd-0ab56d64bfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4646f3d85db242c0a1642fcedccb8f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='4461287db7d44934b2f84e1fcdba618a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852995a-b3e1-4d38-a71a-ceedbac6e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852995a-b3e1-4d38-a71a-ceedbac6e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb988b5-4f30-42c1-aef0-7aceedeb28df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb988b5-4f30-42c1-aef0-7aceedeb28df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fcf729b-3664-49c6-acfd-0ab56d64bfdb', 'volume_name': 'volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb', 'volume_size': 1, 'image_id': '89822013-4111-43bf-bb2f-eabef70308ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf0b6a40d086a1424e682fc31b5d6b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4646f3d85db242c0a1642fcedccb8f92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '346c3851b7f2ac0299f8aa4bd92880476ad13450b8961aa2268afc2499397c86887f5b589e667e1227221411d7dc9e817a2c520cfbbc3a87a1b19734b5d8444d', 'id': '89822013-4111-43bf-bb2f-eabef70308ad', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89822013-4111-43bf-bb2f-eabef70308ad/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9282fdd-11db-4e49-8d2e-dc93e9b9399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9282fdd-11db-4e49-8d2e-dc93e9b9399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c617810-1014-4497-b6dc-04a62af3252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb', 'volume_size': 1, 'image_id': '89822013-4111-43bf-bb2f-eabef70308ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf0b6a40d086a1424e682fc31b5d6b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4646f3d85db242c0a1642fcedccb8f92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '346c3851b7f2ac0299f8aa4bd92880476ad13450b8961aa2268afc2499397c86887f5b589e667e1227221411d7dc9e817a2c520cfbbc3a87a1b19734b5d8444d', 'id': '89822013-4111-43bf-bb2f-eabef70308ad', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89822013-4111-43bf-bb2f-eabef70308ad/file', 'properties': {}}, 'image_service': } Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Trying to clone 3fcf729b-3664-49c6-acfd-0ab56d64bfdb from image 89822013-4111-43bf-bb2f-eabef70308ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:33:04 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[13054892-8535-401b-949e-387715421fc0]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:04 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:04 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Temporary image 89822013-4111-43bf-bb2f-eabef70308ad is fetched for user 4461287db7d44934b2f84e1fcdba618a. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[19411fe9-e50f-481a-bf77-87f84377aaee]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:05 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:05 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcf729b-3664-49c6-acfd-0ab56d64bfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4646f3d85db242c0a1642fcedccb8f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='4461287db7d44934b2f84e1fcdba618a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Creating volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1073741824 Sep 23 00:33:06 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1073741824" returned: 0 in 0.523s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb Sep 23 00:33:06 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Attempting download of 89822013-4111-43bf-bb2f-eabef70308ad ((None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}])) to volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[964fab33-349a-4d93-ac9d-572707b4066c]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub Sep 23 00:33:07 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub Sep 23 00:33:07 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub" returned: 1 in 0.362s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89822013-4111-43bf-bb2f-eabef70308ad_ifkty7ub' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c2a8b-a0c9-43c1-802a-21a023d83dd3]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:07 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD Sep 23 00:33:08 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] 89822013-4111-43bf-bb2f-eabef70308ad was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb Sep 23 00:33:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89822013-4111-43bf-bb2f-eabef70308ad_ccci9j80devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:08 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:33:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1G Sep 23 00:33:08 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb 1G" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Downloaded image 89822013-4111-43bf-bb2f-eabef70308ad ((None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}])) to volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Temporary image 89822013-4111-43bf-bb2f-eabef70308ad for user 4461287db7d44934b2f84e1fcdba618a is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Marking volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Copying metadata from image 89822013-4111-43bf-bb2f-eabef70308ad to 3fcf729b-3664-49c6-acfd-0ab56d64bfdb. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Creating volume glance metadata for volume 3fcf729b-3664-49c6-acfd-0ab56d64bfdb backed by image 89822013-4111-43bf-bb2f-eabef70308ad with: {'image_id': '89822013-4111-43bf-bb2f-eabef70308ad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7cf0b6a40d086a1424e682fc31b5d6b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c617810-1014-4497-b6dc-04a62af3252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb', 'volume_size': 1, 'image_id': '89822013-4111-43bf-bb2f-eabef70308ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89822013-4111-43bf-bb2f-eabef70308ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf0b6a40d086a1424e682fc31b5d6b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4646f3d85db242c0a1642fcedccb8f92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '346c3851b7f2ac0299f8aa4bd92880476ad13450b8961aa2268afc2499397c86887f5b589e667e1227221411d7dc9e817a2c520cfbbc3a87a1b19734b5d8444d', 'id': '89822013-4111-43bf-bb2f-eabef70308ad', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89822013-4111-43bf-bb2f-eabef70308ad/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee971b9-866d-4897-bbc7-d7de37ab121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Volume volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb (3fcf729b-3664-49c6-acfd-0ab56d64bfdb): created successfully Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee971b9-866d-4897-bbc7-d7de37ab121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Flow 'volume_create_manager' (e85f36e5-52d0-43ce-b798-12f5deedebfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-7d1d6925-0894-44e7-84d0-6eabdc580190 tempest-VolumeImageDependencyTests-1133017228 None] Created volume successfully. Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Acquiring lock "cinder-3fcf729b-3664-49c6-acfd-0ab56d64bfdb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "cinder-3fcf729b-3664-49c6-acfd-0ab56d64bfdb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Acquiring lock "cinder-quobyte-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "cinder-quobyte-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0ee253-cce4-4e84-be35-7ea7450dd01b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb Sep 23 00:33:10 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" returned: 0 in 0.472s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb Sep 23 00:33:10 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "cinder-quobyte-3fcf729b-3664-49c6-acfd-0ab56d64bfdb" released by "delete_volume" :: held 0.822s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Created reservations ['dc9a7d15-cb0b-4680-b8c4-97deb7a37823', '361809e4-16c0-428f-9c09-1a976a91afe9', 'de502c46-93a2-4396-81f6-8bd4cc6ee7f0', 'f9603bc0-404d-46cd-8791-dffb340a48c9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:11 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Deleted volume successfully. Sep 23 00:33:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-45aa9666-760e-4d8b-bb88-338565cbae78 tempest-VolumeImageDependencyTests-1133017228 None] Lock "cinder-3fcf729b-3664-49c6-acfd-0ab56d64bfdb-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=107,cinder:SELECT=78,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:21 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=111,cinder:DELETE=13,cinder:SELECT=69,cinder:INSERT=30 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (23427942-75f4-480e-bf6c-97f7bf4fe893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865c4a0d-4955-4777-869a-78aace9dbcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865c4a0d-4955-4777-869a-78aace9dbcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703498065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a1c84c-d619-4505-aa37-b4e9cd8ba75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:31Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5da73f-1fb8-4d98-8696-676f71ef8973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5da73f-1fb8-4d98-8696-676f71ef8973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01bf4d8-2096-45a1-aed7-d7a16b3ef39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01bf4d8-2096-45a1-aed7-d7a16b3ef39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a1c84c-d619-4505-aa37-b4e9cd8ba75c', 'volume_name': 'volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944782e5-ef8c-47f5-8ad5-bf555b1c0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944782e5-ef8c-47f5-8ad5-bf555b1c0693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62033b97-bb46-46e5-bdaa-c31c47da3959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:30 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume f6a1c84c-d619-4505-aa37-b4e9cd8ba75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c', 'volume_size': 1} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703498065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a1c84c-d619-4505-aa37-b4e9cd8ba75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:31Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume f6a1c84c-d619-4505-aa37-b4e9cd8ba75c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:31 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c 1073741824 Sep 23 00:33:31 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Flow 'volume_create_manager' (0df9c6c8-d167-49c8-aae3-16c461fc56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61897bcc-0908-4951-96cb-068d3b33c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61897bcc-0908-4951-96cb-068d3b33c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-332342178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80312d-8ae1-451e-a9b9-c7efce759d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87cc0a8d5bdf4022ae13ffd196aed39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:31Z,use_quota=True,user_id='6734fd33b9684d619b6b049ef346bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf56cebc-cc4b-4d47-8aea-b9a5045f13f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf56cebc-cc4b-4d47-8aea-b9a5045f13f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ca90ff-4918-4e17-bc9e-b15c5c40b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ca90ff-4918-4e17-bc9e-b15c5c40b418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c80312d-8ae1-451e-a9b9-c7efce759d38', 'volume_name': 'volume-9c80312d-8ae1-451e-a9b9-c7efce759d38', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e7c66-0411-4d1b-a471-7df8b6d81cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e7c66-0411-4d1b-a471-7df8b6d81cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38017afc-5566-499a-b893-1ac292753dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Volume 9c80312d-8ae1-451e-a9b9-c7efce759d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c80312d-8ae1-451e-a9b9-c7efce759d38', 'volume_size': 1} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:31 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c 1073741824" returned: 0 in 0.659s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c Sep 23 00:33:31 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (35b75fb8-3cef-4df9-8061-1d9383dabe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75ac59d-691c-4b09-a227-83869972bcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75ac59d-691c-4b09-a227-83869972bcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1472933003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9013d6-fac8-4cb9-8df6-3b383fa4e528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:32Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c1d19f-32e4-46e0-863f-a9ba1bf09a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c1d19f-32e4-46e0-863f-a9ba1bf09a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9110a0-095b-40d8-b5ad-d778155c53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9110a0-095b-40d8-b5ad-d778155c53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9013d6-fac8-4cb9-8df6-3b383fa4e528', 'volume_name': 'volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f3ce68-dfbe-4210-9188-6687d02a9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f3ce68-dfbe-4210-9188-6687d02a9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4322b77-28e9-45ab-87c9-34501b447910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Volume 5c9013d6-fac8-4cb9-8df6-3b383fa4e528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528', 'volume_size': 1} Sep 23 00:33:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:32 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-332342178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c80312d-8ae1-451e-a9b9-c7efce759d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87cc0a8d5bdf4022ae13ffd196aed39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:31Z,use_quota=True,user_id='6734fd33b9684d619b6b049ef346bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Creating volume 9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:32 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62033b97-bb46-46e5-bdaa-c31c47da3959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 1073741824 Sep 23 00:33:32 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4df1b7-c531-4f02-b3bd-17505035b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c (f6a1c84c-d619-4505-aa37-b4e9cd8ba75c): created successfully Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4df1b7-c531-4f02-b3bd-17505035b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (23427942-75f4-480e-bf6c-97f7bf4fe893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:32 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-c544efdf-fdd7-4d86-abc7-f4401c59a1b9 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (002865c9-6daa-4576-8777-234deb010919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec404ce0-1fd0-471b-b690-ef1a010a390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec404ce0-1fd0-471b-b690-ef1a010a390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297706828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d60ef4-c4fa-4772-ab33-b7ff02bda52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:32Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a5c11-8441-4b0d-8b0a-610e72bbbe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373a5c11-8441-4b0d-8b0a-610e72bbbe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d8666d-45b0-4a15-9523-254f6d118656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d8666d-45b0-4a15-9523-254f6d118656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d60ef4-c4fa-4772-ab33-b7ff02bda52d', 'volume_name': 'volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07632262-79aa-4b31-9f70-fa3b16b7ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07632262-79aa-4b31-9f70-fa3b16b7ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1ebaf-95a7-4afc-86ac-87527942aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:32 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Volume c1d60ef4-c4fa-4772-ab33-b7ff02bda52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d', 'volume_size': 1} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:32 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 1073741824" returned: 0 in 0.688s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:33:32 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (ee1ae6ab-1886-423a-861e-6e0477076495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe26200-5093-4845-a08e-2519eefe352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe26200-5093-4845-a08e-2519eefe352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718070484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0586db-a4e5-40da-84b9-967a5c2a02f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:33Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc621e-18a5-4364-b5ff-bee1a10770d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dc621e-18a5-4364-b5ff-bee1a10770d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58849594-ac13-46e8-aa44-494d5cf849d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58849594-ac13-46e8-aa44-494d5cf849d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0586db-a4e5-40da-84b9-967a5c2a02f2', 'volume_name': 'volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da2fef3-e3d8-4346-ae7f-253d7b827089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da2fef3-e3d8-4346-ae7f-253d7b827089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c725c598-7372-4f56-a61a-3117ccb90781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Volume 4d0586db-a4e5-40da-84b9-967a5c2a02f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2', 'volume_size': 1} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.499s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1472933003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9013d6-fac8-4cb9-8df6-3b383fa4e528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:32Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Creating volume 5c9013d6-fac8-4cb9-8df6-3b383fa4e528 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38017afc-5566-499a-b893-1ac292753dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c80312d-8ae1-451e-a9b9-c7efce759d38', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b374b6a9-14df-4aed-aa4e-d46bef962e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Volume volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 (9c80312d-8ae1-451e-a9b9-c7efce759d38): created successfully Sep 23 00:33:33 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 1073741824 Sep 23 00:33:33 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b374b6a9-14df-4aed-aa4e-d46bef962e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Flow 'volume_create_manager' (0df9c6c8-d167-49c8-aae3-16c461fc56fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-369daa89-d552-419b-a4fe-209840049772 tempest-VolumeDependencyTests-89700287 None] Created volume successfully. Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (ea8dce31-becc-49b1-a3a3-efa9354f7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0c7e1e-a769-46e5-86bc-ac7a431a23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0c7e1e-a769-46e5-86bc-ac7a431a23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778422864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5487546-d1e0-4354-aaf0-862d6f8c1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0884f723-d3d0-4f42-9ed9-ab478aeddf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0884f723-d3d0-4f42-9ed9-ab478aeddf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8d1793-3211-45ff-a9c0-5e49b8e79457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8d1793-3211-45ff-a9c0-5e49b8e79457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5487546-d1e0-4354-aaf0-862d6f8c1f06', 'volume_name': 'volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fee28-2191-45d6-888d-3f46757d6885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fee28-2191-45d6-888d-3f46757d6885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd8ea1c-f885-4188-ab99-c4ed61e02077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Volume e5487546-d1e0-4354-aaf0-862d6f8c1f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06', 'volume_size': 1} Sep 23 00:33:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:34 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 1073741824" returned: 0 in 0.987s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:34 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 Sep 23 00:33:34 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (120cc164-70db-4706-abf6-bcccbb5c74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1daa3bd-c6c9-4dcf-b430-dc0cdcd624ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1daa3bd-c6c9-4dcf-b430-dc0cdcd624ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708173061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c23710-9ba7-42c0-b9d8-8d2dc52b863c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c6f3c0-c70b-4f7d-a598-b6f4c7d9c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c6f3c0-c70b-4f7d-a598-b6f4c7d9c348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c369e1-b52f-4d48-ba06-916d48284910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c369e1-b52f-4d48-ba06-916d48284910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c23710-9ba7-42c0-b9d8-8d2dc52b863c', 'volume_name': 'volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf5ba52-5b08-4b1a-a36f-ea4262818361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf5ba52-5b08-4b1a-a36f-ea4262818361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449cfa23-e08e-4a2a-a490-885d4d4f20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume 50c23710-9ba7-42c0-b9d8-8d2dc52b863c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c', 'volume_size': 1} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (997ce155-809b-4652-8c67-c33eef9fd36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60a9bde-d637-4865-a02a-5f41f1ecc098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60a9bde-d637-4865-a02a-5f41f1ecc098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882163561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e9de6e-9f2d-4115-a6e9-5c16112dddf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4dbcd6-b842-44bd-af22-cfa564f3aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4dbcd6-b842-44bd-af22-cfa564f3aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09baa722-07b0-4d84-b2b8-5ce296659654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09baa722-07b0-4d84-b2b8-5ce296659654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e9de6e-9f2d-4115-a6e9-5c16112dddf7', 'volume_name': 'volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958b24ab-cc9a-439f-b7d2-f251ffd59d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958b24ab-cc9a-439f-b7d2-f251ffd59d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85f025e-cb9d-415b-9d32-b5ea2674a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Volume 68e9de6e-9f2d-4115-a6e9-5c16112dddf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7', 'volume_size': 1} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:34 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" returned: 0 in 0.513s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297706828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d60ef4-c4fa-4772-ab33-b7ff02bda52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:32Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Creating volume c1d60ef4-c4fa-4772-ab33-b7ff02bda52d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:34 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4322b77-28e9-45ab-87c9-34501b447910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d 1073741824 Sep 23 00:33:35 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a7550-40f8-4000-910b-c28de18a8cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Volume volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 (5c9013d6-fac8-4cb9-8df6-3b383fa4e528): created successfully Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a7550-40f8-4000-910b-c28de18a8cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (35b75fb8-3cef-4df9-8061-1d9383dabe9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8d7945e6-ba17-4659-981a-f188b559b088 tempest-CreateVolumesFromImageTest-1166081862 None] Created volume successfully. Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (9e4b134f-7eb0-4458-8b08-e92559408499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c03e0c-1b25-49fb-bc9b-99cf17cd7edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c03e0c-1b25-49fb-bc9b-99cf17cd7edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651306092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed0aa49-ae9e-4542-a80f-00bd106ef430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:35Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029d8629-59af-47aa-b060-3b798774bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029d8629-59af-47aa-b060-3b798774bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c9f3c-0a71-4bfc-a243-13f4f6c8c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c9f3c-0a71-4bfc-a243-13f4f6c8c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed0aa49-ae9e-4542-a80f-00bd106ef430', 'volume_name': 'volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33975b9c-04e3-42c9-acb3-f16543a45194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33975b9c-04e3-42c9-acb3-f16543a45194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01587e41-0aad-4781-af51-5b00566ba3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume 1ed0aa49-ae9e-4542-a80f-00bd106ef430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430', 'volume_size': 1} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (dd632b9e-97dc-4540-a1bc-0a951706729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2097518-bb0a-4351-8680-d353fb56790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2097518-bb0a-4351-8680-d353fb56790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1211336893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb581ac8-34f8-4aa2-8471-f30a0e69c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d439387-54c9-448d-b654-fe9fe06a054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d439387-54c9-448d-b654-fe9fe06a054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1076d803-8b5f-49b3-b4ab-084068c43976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1076d803-8b5f-49b3-b4ab-084068c43976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb581ac8-34f8-4aa2-8471-f30a0e69c258', 'volume_name': 'volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d061fbc3-faec-4485-806b-2c01e9f00992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d061fbc3-faec-4485-806b-2c01e9f00992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:35 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a40282-c126-4350-a7bd-168c47c659b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:35 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume bb581ac8-34f8-4aa2-8471-f30a0e69c258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258', 'volume_size': 1} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d 1073741824" returned: 0 in 0.923s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d Sep 23 00:33:35 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (f32baaa1-dc27-43cb-a763-631d72006bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f96630e-4d78-4891-a09e-6b3b6dac3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f96630e-4d78-4891-a09e-6b3b6dac3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502411920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf61c794-41fa-43a7-ae44-870a4879e96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b86c90f-e4ec-4cb8-bc0b-ad202751074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b86c90f-e4ec-4cb8-bc0b-ad202751074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7ffc3b-b743-4b0a-a096-69186904d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7ffc3b-b743-4b0a-a096-69186904d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf61c794-41fa-43a7-ae44-870a4879e96c', 'volume_name': 'volume-bf61c794-41fa-43a7-ae44-870a4879e96c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6122cfbf-e2bb-4b58-9015-204f394dae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6122cfbf-e2bb-4b58-9015-204f394dae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d38fe72-7453-4b9b-8760-ff31747f0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume bf61c794-41fa-43a7-ae44-870a4879e96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf61c794-41fa-43a7-ae44-870a4879e96c', 'volume_size': 1} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.070s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1718070484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d0586db-a4e5-40da-84b9-967a5c2a02f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:33Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Creating volume 4d0586db-a4e5-40da-84b9-967a5c2a02f2 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:36 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd1ebaf-95a7-4afc-86ac-87527942aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476a5309-a075-4e65-8621-e1ba73c11c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 1073741824 Sep 23 00:33:36 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Volume volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d (c1d60ef4-c4fa-4772-ab33-b7ff02bda52d): created successfully Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476a5309-a075-4e65-8621-e1ba73c11c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (002865c9-6daa-4576-8777-234deb010919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5f5fdbd5-7498-4666-9a0b-69d89ee894b6 tempest-CreateVolumesFromImageTest-1166081862 None] Created volume successfully. Sep 23 00:33:37 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 1073741824" returned: 0 in 0.756s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (9179719e-e980-4d72-9a08-7729877dcc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9ce500-35de-4735-97c9-42c4e996cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9ce500-35de-4735-97c9-42c4e996cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246757885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e471c-3205-4d4d-a5f9-4eb586f76b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 Sep 23 00:33:37 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23829be2-fd98-4e5b-b70d-c5dcce659553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23829be2-fd98-4e5b-b70d-c5dcce659553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b717db-2eab-43c1-9588-91f5dc1c65ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b717db-2eab-43c1-9588-91f5dc1c65ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89e471c-3205-4d4d-a5f9-4eb586f76b35', 'volume_name': 'volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd54c3-5d64-4180-b73e-37c15ffb5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd54c3-5d64-4180-b73e-37c15ffb5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4989b707-7ad3-46d3-bb4e-fa4a703dd568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume e89e471c-3205-4d4d-a5f9-4eb586f76b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35', 'volume_size': 1} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Flow 'volume_create_manager' (f2941111-7007-4d63-bd7c-7b673caf9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b539c94-f653-4a86-9926-05461915abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b539c94-f653-4a86-9926-05461915abc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e859a0-fd2b-4338-a6d6-98586224ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685773fcd7eb4eefa411dffcfc25c82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='dd996302e6cf46a0aa5cc4672de6dc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1822b516-d7d5-4bb1-ba49-b641d97bad98),volume_type_id=1822b516-d7d5-4bb1-ba49-b641d97bad98)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5878c2-974d-47a6-b5f2-f32267d8db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5878c2-974d-47a6-b5f2-f32267d8db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f5e2a2-60c2-4562-baa7-7154a3ac1348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:33:37 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778422864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5487546-d1e0-4354-aaf0-862d6f8c1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Creating volume e5487546-d1e0-4354-aaf0-862d6f8c1f06 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c725c598-7372-4f56-a61a-3117ccb90781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 1073741824 Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84c992e-6307-403a-b39d-26ddae4b9c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Volume volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 (4d0586db-a4e5-40da-84b9-967a5c2a02f2): created successfully Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84c992e-6307-403a-b39d-26ddae4b9c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (ee1ae6ab-1886-423a-861e-6e0477076495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-45d0c259-df23-414e-9b91-7772da3d336f tempest-CreateVolumesFromImageTest-1166081862 None] Created volume successfully. Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f5e2a2-60c2-4562-baa7-7154a3ac1348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12e859a0-fd2b-4338-a6d6-98586224ccdb', 'volume_name': 'volume-12e859a0-fd2b-4338-a6d6-98586224ccdb', 'volume_size': 1, 'image_id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f618f65b0a4f2224dbc48db877286a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '685773fcd7eb4eefa411dffcfc25c82d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e64a755c0a9c1ed1a4c915eaec829135d1c83b7cfb7dea7b2a54e637e57fdf41c917d407b44363db101f5e182f40da209a32411dc1757662e1866aadc88f92', 'id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed96635-5f19-464a-9799-dbe96cee30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed96635-5f19-464a-9799-dbe96cee30e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fabcb2b-ec81-4754-a3bd-5f1398ba8f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Volume 12e859a0-fd2b-4338-a6d6-98586224ccdb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12e859a0-fd2b-4338-a6d6-98586224ccdb', 'volume_size': 1, 'image_id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f618f65b0a4f2224dbc48db877286a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '685773fcd7eb4eefa411dffcfc25c82d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e64a755c0a9c1ed1a4c915eaec829135d1c83b7cfb7dea7b2a54e637e57fdf41c917d407b44363db101f5e182f40da209a32411dc1757662e1866aadc88f92', 'id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Trying to clone 12e859a0-fd2b-4338-a6d6-98586224ccdb from image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:33:37 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e3c04a-fac4-4d8d-980d-e21ca9d71842]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:37 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:37 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 1073741824" returned: 0 in 0.555s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 Sep 23 00:33:38 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-708173061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c23710-9ba7-42c0-b9d8-8d2dc52b863c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume 50c23710-9ba7-42c0-b9d8-8d2dc52b863c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd8ea1c-f885-4188-ab99-c4ed61e02077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8932cc-d099-40fe-bd6e-8e300625fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:38 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c 1073741824 Sep 23 00:33:38 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Volume volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 (e5487546-d1e0-4354-aaf0-862d6f8c1f06): created successfully Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8932cc-d099-40fe-bd6e-8e300625fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (ea8dce31-becc-49b1-a3a3-efa9354f7199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ee1d5d20-2a17-413b-9706-e644c8d40f22 tempest-CreateVolumesFromImageTest-1166081862 None] Created volume successfully. Sep 23 00:33:38 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:38 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Temporary image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e is fetched for user dd996302e6cf46a0aa5cc4672de6dc43. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1540039e-1d67-4911-9e29-d7dc7eab986a]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:38 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c 1073741824" returned: 0 in 0.642s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c Sep 23 00:33:39 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" returned: 0 in 0.328s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882163561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e9de6e-9f2d-4115-a6e9-5c16112dddf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c19b9f2f66b499e8bcbe2d4c0531c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:34Z,use_quota=True,user_id='7871c85a1ef14f9fb1e99058b6ee95b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Creating volume 68e9de6e-9f2d-4115-a6e9-5c16112dddf7 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:39 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 1073741824 Sep 23 00:33:39 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:39 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449cfa23-e08e-4a2a-a490-885d4d4f20eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94fa6d-8e97-4171-8b02-8ffd3aad6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c (50c23710-9ba7-42c0-b9d8-8d2dc52b863c): created successfully Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94fa6d-8e97-4171-8b02-8ffd3aad6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (120cc164-70db-4706-abf6-bcccbb5c74e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f339a7a7-0151-409c-8658-5d0176c1ce3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:39 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:39 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 1073741824" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 Sep 23 00:33:39 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.905s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85f025e-cb9d-415b-9d32-b5ea2674a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babb83b-f76b-41d9-80e5-e1b58bb73a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Creating offline snapshot 55973d2e-da37-493e-8a8f-3adceb98e1f3 of volume 9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:40 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Volume volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 (68e9de6e-9f2d-4115-a6e9-5c16112dddf7): created successfully Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babb83b-f76b-41d9-80e5-e1b58bb73a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Flow 'volume_create_manager' (997ce155-809b-4652-8c67-c33eef9fd36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[997299e2-df05-43cf-b67e-1fd921250356]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f0d4aef8-86ab-4bfd-b1e7-624aeaf38a4b tempest-CreateVolumesFromImageTest-1166081862 None] Created volume successfully. Sep 23 00:33:40 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:33:40 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.371s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 1G Sep 23 00:33:40 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 1G" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:33:41 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 is being set with open permissions: ugo+rw Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:33:41 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-68e9de6e-9f2d-4115-a6e9-5c16112dddf7-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-68e9de6e-9f2d-4115-a6e9-5c16112dddf7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-quobyte-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5de213-ed64-4005-9699-fefe2631f16e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 Sep 23 00:33:41 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info Sep 23 00:33:41 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info" returned: 0 in 0.288s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7 Sep 23 00:33:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info is being set with open permissions: ugo+rw Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info Sep 23 00:33:42 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-68e9de6e-9f2d-4115-a6e9-5c16112dddf7" released by "delete_volume" :: held 0.726s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Created reservations ['0646819d-87c0-437d-89ad-996e2896fb14', '5b1dce12-c210-4fdc-8f6d-00873f71eaa7', 'a45cdb02-6f49-4216-bd1f-5b2d7fda8559', '03ec176c-1062-4804-bb72-13471fa7080e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:42 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.info" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651306092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed0aa49-ae9e-4542-a80f-00bd106ef430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:35Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume 1ed0aa49-ae9e-4542-a80f-00bd106ef430 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 1073741824 Sep 23 00:33:42 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d03315f2-9d3d-4083-866a-cff1c335f614 tempest-VolumeDependencyTests-89700287 None] Create snapshot completed successfully Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:42 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-e5487546-d1e0-4354-aaf0-862d6f8c1f06-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-e5487546-d1e0-4354-aaf0-862d6f8c1f06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-quobyte-e5487546-d1e0-4354-aaf0-862d6f8c1f06" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-e5487546-d1e0-4354-aaf0-862d6f8c1f06" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:42 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.330s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Deleted volume successfully. Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc7e64-bdbe-4c1d-8282-60c0c526a1af]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a1a614e-2e43-4a6f-939f-ecdfb48e20f1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-68e9de6e-9f2d-4115-a6e9-5c16112dddf7-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:42 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 Sep 23 00:33:42 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 1073741824" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 Sep 23 00:33:43 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06 Sep 23 00:33:43 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.570s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1211336893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb581ac8-34f8-4aa2-8471-f30a0e69c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume bb581ac8-34f8-4aa2-8471-f30a0e69c258 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01587e41-0aad-4781-af51-5b00566ba3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aac4431-63f3-4e09-ac23-3492b4720144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 1073741824 Sep 23 00:33:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 (1ed0aa49-ae9e-4542-a80f-00bd106ef430): created successfully Sep 23 00:33:43 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aac4431-63f3-4e09-ac23-3492b4720144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (9e4b134f-7eb0-4458-8b08-e92559408499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d30a6cfc-423d-4d68-8dab-f6c8afc77876 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:43 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e5487546-d1e0-4354-aaf0-862d6f8c1f06" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-e5487546-d1e0-4354-aaf0-862d6f8c1f06" released by "delete_volume" :: held 0.860s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Flow 'volume_create_manager' (2a63aa02-8843-4337-9489-09a03adcb3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521a58d-ff3a-4042-ac5f-6d7fd7af4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521a58d-ff3a-4042-ac5f-6d7fd7af4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1619829285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b68339-3f43-410e-8f0e-19742296d6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87cc0a8d5bdf4022ae13ffd196aed39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55973d2e-da37-493e-8a8f-3adceb98e1f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:44Z,use_quota=True,user_id='6734fd33b9684d619b6b049ef346bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a69257-ce4c-49d4-80ab-b68aa6c7f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a69257-ce4c-49d4-80ab-b68aa6c7f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e737a1d0-89d6-4504-a580-c253cf859e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e737a1d0-89d6-4504-a580-c253cf859e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9b68339-3f43-410e-8f0e-19742296d6c1', 'volume_name': 'volume-b9b68339-3f43-410e-8f0e-19742296d6c1', 'volume_size': 1, 'snapshot_id': '55973d2e-da37-493e-8a8f-3adceb98e1f3'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487bb0d8-b266-433d-b22e-f59b1b2eaf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487bb0d8-b266-433d-b22e-f59b1b2eaf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4207ccf-36bc-4dd3-b834-0a68657e00e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Volume b9b68339-3f43-410e-8f0e-19742296d6c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9b68339-3f43-410e-8f0e-19742296d6c1', 'volume_size': 1, 'snapshot_id': '55973d2e-da37-493e-8a8f-3adceb98e1f3'} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Created reservations ['34699fe0-6ade-4e26-aae0-ed064233ab03', 'cea3462a-0d53-47f6-9465-04653236403b', '02af1b7c-e517-4b4f-b1cf-44b0fc540fa0', '75601a2b-796b-4d67-a998-3a71bcd6096e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:43 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 1073741824" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 Sep 23 00:33:44 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Deleted volume successfully. Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-264f51f1-a134-454b-b351-fc4fe8500673 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-e5487546-d1e0-4354-aaf0-862d6f8c1f06-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:44 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502411920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf61c794-41fa-43a7-ae44-870a4879e96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:36Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume bf61c794-41fa-43a7-ae44-870a4879e96c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:44 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c 1073741824 Sep 23 00:33:44 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a40282-c126-4350-a7bd-168c47c659b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8920093-6999-4b9c-9756-5187f96a4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:44 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 (bb581ac8-34f8-4aa2-8471-f30a0e69c258): created successfully Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8920093-6999-4b9c-9756-5187f96a4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (dd632b9e-97dc-4540-a1bc-0a951706729f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fe74811c-652a-4d4a-982d-7b08091ff8d5 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:44 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c 1073741824" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c Sep 23 00:33:44 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-4d0586db-a4e5-40da-84b9-967a5c2a02f2-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-4d0586db-a4e5-40da-84b9-967a5c2a02f2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-quobyte-4d0586db-a4e5-40da-84b9-967a5c2a02f2" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-4d0586db-a4e5-40da-84b9-967a5c2a02f2" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:45 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.844s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246757885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e471c-3205-4d4d-a5f9-4eb586f76b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bbe770a73047d4b096c8776cb40f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='30f0608d61c940b39039bc08992ee41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Creating volume e89e471c-3205-4d4d-a5f9-4eb586f76b35 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a84958a-be4c-448d-a337-ce0a710c0c90]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 1073741824 Sep 23 00:33:45 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d38fe72-7453-4b9b-8760-ff31747f0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf61c794-41fa-43a7-ae44-870a4879e96c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425e0ca2-d347-46a3-9e98-ed208fc22321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-bf61c794-41fa-43a7-ae44-870a4879e96c (bf61c794-41fa-43a7-ae44-870a4879e96c): created successfully Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425e0ca2-d347-46a3-9e98-ed208fc22321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (f32baaa1-dc27-43cb-a763-631d72006bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-35990af4-f71c-4755-be70-25e323b53784 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:45 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 Sep 23 00:33:45 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 1073741824" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2 Sep 23 00:33:45 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 Sep 23 00:33:45 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4d0586db-a4e5-40da-84b9-967a5c2a02f2" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-4d0586db-a4e5-40da-84b9-967a5c2a02f2" released by "delete_volume" :: held 0.789s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.169s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e859a0-fd2b-4338-a6d6-98586224ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685773fcd7eb4eefa411dffcfc25c82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='dd996302e6cf46a0aa5cc4672de6dc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1822b516-d7d5-4bb1-ba49-b641d97bad98),volume_type_id=1822b516-d7d5-4bb1-ba49-b641d97bad98)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Creating volume 12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:45 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1073741824 Sep 23 00:33:45 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4989b707-7ad3-46d3-bb4e-fa4a703dd568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939f5d56-0a87-4e73-9df1-51e5d693f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Volume volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 (e89e471c-3205-4d4d-a5f9-4eb586f76b35): created successfully Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939f5d56-0a87-4e73-9df1-51e5d693f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Flow 'volume_create_manager' (9179719e-e980-4d72-9a08-7729877dcc0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Created reservations ['248aa3c6-bbe1-434f-9468-996c94f909d2', 'ecacc736-f9e9-4d14-9b0c-8bf16530728f', '3b5a20a5-8fb4-40b6-a198-13c22f4ca2f2', '9de4a4ec-109e-4c71-8162-c0b166a1a614'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d9b2c966-7221-407f-bd81-9e1eafd4bc3a tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created volume successfully. Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:46 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-quobyte-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3fee6-9cc2-40ae-a91e-136951d6df72]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.305s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:46 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Deleted volume successfully. Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-b60ad306-d460-4530-87c6-3c00d326bed8 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-4d0586db-a4e5-40da-84b9-967a5c2a02f2-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:46 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1073741824" returned: 0 in 0.532s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d Sep 23 00:33:46 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb Sep 23 00:33:46 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:46 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d Sep 23 00:33:46 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.966s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3-b9b68339-3f43-410e-8f0e-19742296d6c1" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3-b9b68339-3f43-410e-8f0e-19742296d6c1" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Creating volume b9b68339-3f43-410e-8f0e-19742296d6c1 from snapshot 55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Attempting download of 1b56ec1f-bcd5-4463-a387-21359f3d6d1e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}])) to volume 12e859a0-fd2b-4338-a6d6-98586224ccdb. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] snapshot: 55973d2e-da37-493e-8a8f-3adceb98e1f3, volume: b9b68339-3f43-410e-8f0e-19742296d6c1, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-e89e471c-3205-4d4d-a5f9-4eb586f76b35-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcdcb07-7f8a-4d75-a32a-4475ab99df76]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95fe2b-e722-4f4d-a2bf-448859ac8f37]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-e89e471c-3205-4d4d-a5f9-4eb586f76b35-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-e89e471c-3205-4d4d-a5f9-4eb586f76b35" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-e89e471c-3205-4d4d-a5f9-4eb586f76b35" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd37cd-1d55-40c6-b844-1fdead0d6c21]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:33:47 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d" released by "delete_volume" :: held 0.840s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8 Sep 23 00:33:47 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Created reservations ['b8fdc13a-d819-4100-8642-47e5bbf8fad3', 'f5a03f78-8960-477d-9f08-2b9a8145eaad', '53885f93-b025-4097-8cf5-ea4f2c5b3fcd', '2cfa8a72-8c4b-4880-a554-472f806f626e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:47 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 Sep 23 00:33:47 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:47 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-5c9013d6-fac8-4cb9-8df6-3b383fa4e528-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c80312d-8ae1-451e-a9b9-c7efce759d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-5c9013d6-fac8-4cb9-8df6-3b383fa4e528-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef11d76-6773-4700-95b0-cf84434d3395]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8" returned: 0 in 0.593s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "cinder-quobyte-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e64cf-429e-4afd-8c7b-1e5c600e7328]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:33:47 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35" returned: 0 in 0.616s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8 Sep 23 00:33:47 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35 Sep 23 00:33:47 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Deleted volume successfully. Sep 23 00:33:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2be75c5a-a6f5-4cb9-be90-93e25c4795c1 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-c1d60ef4-c4fa-4772-ab33-b7ff02bda52d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 Sep 23 00:33:47 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e89e471c-3205-4d4d-a5f9-4eb586f76b35" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.568s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-e89e471c-3205-4d4d-a5f9-4eb586f76b35" released by "delete_volume" :: held 1.048s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8" returned: 1 in 0.550s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_0xtj_ff8' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f88d34f-6e05-4c02-926b-266e6558b878]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 Sep 23 00:33:48 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['0b22afea-2202-4c08-b66c-5c367d6c534a', '5110e035-5429-49ba-b1f8-e39349e23bc1', '7c24c993-5cd2-467e-bc09-839f3c0afea8', 'aeeea5af-f87c-4376-83c8-e5b35f280ce8'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:48 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:48 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" returned: 0 in 0.564s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:48 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528 Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:48 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:48 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:48 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD Sep 23 00:33:48 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-quobyte-5c9013d6-fac8-4cb9-8df6-3b383fa4e528" released by "delete_volume" :: held 1.075s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a2d04dac-744a-4708-af08-78fab063ba4f tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-e89e471c-3205-4d4d-a5f9-4eb586f76b35-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:48 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Created reservations ['40970c82-7211-4941-856b-5c49bb250b31', '357634eb-35d4-4b35-b438-dc3d6632a686', '5cce0995-e534-430f-8872-ad73ac234045', '2fc8dcc8-e2d2-4f3f-bc9d-fa684ea4c0f4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:49 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] 1b56ec1f-bcd5-4463-a387-21359f3d6d1e was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb Sep 23 00:33:49 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-bf61c794-41fa-43a7-ae44-870a4879e96c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-bf61c794-41fa-43a7-ae44-870a4879e96c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-bf61c794-41fa-43a7-ae44-870a4879e96c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-bf61c794-41fa-43a7-ae44-870a4879e96c" acquired by "delete_volume" :: waited 0.040s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:49 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.485s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:49 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Deleted volume successfully. Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecebab4-86a6-423f-bae2-43f502a3b548]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-442aa61f-bc4b-436a-a693-3ec251017f42 tempest-CreateVolumesFromImageTest-1166081862 None] Lock "cinder-5c9013d6-fac8-4cb9-8df6-3b383fa4e528-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:49 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c Sep 23 00:33:49 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:49 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:50 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c" returned: 0 in 0.970s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb" returned: 0 in 1.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b56ec1f-bcd5-4463-a387-21359f3d6d1e_1_mlj5undevstack@QuobyteHD, size 0.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:50 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:33:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c Sep 23 00:33:50 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1G Sep 23 00:33:50 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bf61c794-41fa-43a7-ae44-870a4879e96c" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-bf61c794-41fa-43a7-ae44-870a4879e96c" released by "delete_volume" :: held 1.671s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['ceaed3c2-0a36-42f6-bcab-260358b3c475', '6ef58c37-cb88-48c6-a24f-bfd7c8fe705e', '8c8b0422-90ca-4f00-95e1-9cc6a30fede5', 'e2f71ab8-1466-464b-87e4-7fb9493a5f0e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:51 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb 1G" returned: 0 in 0.880s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Downloaded image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e ((None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}])) to volume 12e859a0-fd2b-4338-a6d6-98586224ccdb successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Temporary image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e for user dd996302e6cf46a0aa5cc4672de6dc43 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Marking volume 12e859a0-fd2b-4338-a6d6-98586224ccdb as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Copying metadata from image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e to 12e859a0-fd2b-4338-a6d6-98586224ccdb. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Creating volume glance metadata for volume 12e859a0-fd2b-4338-a6d6-98586224ccdb backed by image 1b56ec1f-bcd5-4463-a387-21359f3d6d1e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6f618f65b0a4f2224dbc48db877286a6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:33:51 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:51 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fabcb2b-ec81-4754-a3bd-5f1398ba8f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e859a0-fd2b-4338-a6d6-98586224ccdb', 'volume_size': 1, 'image_id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f618f65b0a4f2224dbc48db877286a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '685773fcd7eb4eefa411dffcfc25c82d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e64a755c0a9c1ed1a4c915eaec829135d1c83b7cfb7dea7b2a54e637e57fdf41c917d407b44363db101f5e182f40da209a32411dc1757662e1866aadc88f92', 'id': '1b56ec1f-bcd5-4463-a387-21359f3d6d1e', 'created_at': datetime.datetime(2026, 9, 22, 22, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 33, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b56ec1f-bcd5-4463-a387-21359f3d6d1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d29b849-4404-4194-8765-49aedd24f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:51 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Volume volume-12e859a0-fd2b-4338-a6d6-98586224ccdb (12e859a0-fd2b-4338-a6d6-98586224ccdb): created successfully Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d29b849-4404-4194-8765-49aedd24f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Flow 'volume_create_manager' (f2941111-7007-4d63-bd7c-7b673caf9929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f5779b98-f08e-47b1-80d8-b0cfc573ccae tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Created volume successfully. Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-bb581ac8-34f8-4aa2-8471-f30a0e69c258-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-bb581ac8-34f8-4aa2-8471-f30a0e69c258-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:52 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-bb581ac8-34f8-4aa2-8471-f30a0e69c258" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.770s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Acquiring lock "cinder-12e859a0-fd2b-4338-a6d6-98586224ccdb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-bb581ac8-34f8-4aa2-8471-f30a0e69c258" acquired by "delete_volume" :: waited 0.126s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-975366b4-4c93-438b-8db1-657eb1ed8776 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-bf61c794-41fa-43a7-ae44-870a4879e96c-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1b352-af35-4cbe-8be8-a38dcdbbd329]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "cinder-12e859a0-fd2b-4338-a6d6-98586224ccdb-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Acquiring lock "cinder-quobyte-12e859a0-fd2b-4338-a6d6-98586224ccdb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "cinder-quobyte-12e859a0-fd2b-4338-a6d6-98586224ccdb" acquired by "delete_volume" :: waited 0.043s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902195d-3cd8-47bb-a134-344f209b0d34]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 Sep 23 00:33:53 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb Sep 23 00:33:53 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258" returned: 0 in 1.122s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb" returned: 0 in 0.899s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258 Sep 23 00:33:53 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb Sep 23 00:33:53 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-bb581ac8-34f8-4aa2-8471-f30a0e69c258" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-bb581ac8-34f8-4aa2-8471-f30a0e69c258" released by "delete_volume" :: held 1.747s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['455e7490-9ee7-4b5f-b1de-62c8782a9cd0', '568513d7-6ff1-426e-80af-e1cafaabe98e', '56873130-af51-4d90-bab8-86b9fd65a752', 'e8007694-9a3e-4a07-8499-69aafae5edc0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:54 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-12e859a0-fd2b-4338-a6d6-98586224ccdb" returned: 0 in 0.641s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "cinder-quobyte-12e859a0-fd2b-4338-a6d6-98586224ccdb" released by "delete_volume" :: held 1.664s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:54 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Created reservations ['bbdc12ee-65b6-414f-9edb-826001644f9a', 'ac4180bb-3fdf-4ea6-98ff-b7302d1a617c', '29f612f4-32d7-410a-8f85-12741ab30cff', 'cfefcc11-f3e4-45f0-86dd-b5300bb1fa92'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-1ed0aa49-ae9e-4542-a80f-00bd106ef430-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-1ed0aa49-ae9e-4542-a80f-00bd106ef430-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-1ed0aa49-ae9e-4542-a80f-00bd106ef430" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-1ed0aa49-ae9e-4542-a80f-00bd106ef430" acquired by "delete_volume" :: waited 0.041s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7565e80-9372-4840-9a6d-066d656821da]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.575s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:33:55 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:55 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e11496f4-daa0-4612-bcc0-f135a6ed9361 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-bb581ac8-34f8-4aa2-8471-f30a0e69c258-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:55 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 Sep 23 00:33:55 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Deleted volume successfully. Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a7b59257-a633-4268-b481-e3b6e625d4af tempest-VolumeAndVolumeTypeFromImageTest-966619759 None] Lock "cinder-12e859a0-fd2b-4338-a6d6-98586224ccdb-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:55 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430" returned: 0 in 0.842s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430 Sep 23 00:33:55 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1ed0aa49-ae9e-4542-a80f-00bd106ef430" returned: 0 in 0.373s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-1ed0aa49-ae9e-4542-a80f-00bd106ef430" released by "delete_volume" :: held 1.362s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['7fff6b12-1e7c-4739-bb6b-6897f90d1909', '6355c0f7-da78-4edd-a664-cb411c847176', '11bc4c40-9775-4330-9073-f2a0fdad97e4', '6f54ec44-68e4-492a-a261-f64312395bce'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:56 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.606s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-dc3fb492-6c24-4620-b996-b51a9edd6ae6 tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-1ed0aa49-ae9e-4542-a80f-00bd106ef430-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-50c23710-9ba7-42c0-b9d8-8d2dc52b863c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-50c23710-9ba7-42c0-b9d8-8d2dc52b863c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (51721223-3fd9-4e5f-9c3b-57b5ea4be779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4450ab50-0df1-4155-a9f3-1dadd001fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" acquired by "delete_volume" :: waited 0.093s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4450ab50-0df1-4155-a9f3-1dadd001fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054235436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb7dd3-4435-4d0a-b627-1cf257049261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:57Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b153de-384f-4585-b4d4-f86661d6bd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b153de-384f-4585-b4d4-f86661d6bd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e988a7d8-461c-46af-b87c-02b42feace9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e988a7d8-461c-46af-b87c-02b42feace9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfb7dd3-4435-4d0a-b627-1cf257049261', 'volume_name': 'volume-ccfb7dd3-4435-4d0a-b627-1cf257049261', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425f36a0-542e-4c4f-bb0e-3871b82f53cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425f36a0-542e-4c4f-bb0e-3871b82f53cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f424912-5cd6-4410-9f1c-3f0eb7bf29ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume ccfb7dd3-4435-4d0a-b627-1cf257049261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfb7dd3-4435-4d0a-b627-1cf257049261', 'volume_size': 1} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dc3ac0-a524-4d2e-98cf-e48f49b42e34]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1" returned: 0 in 9.800s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:57 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Converted 1024.00 MB image at 104.48 MB/s Sep 23 00:33:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 is being set with open permissions: ugo+rw Sep 23 00:33:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c Sep 23 00:33:57 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 Sep 23 00:33:57 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1" returned: 0 in 0.284s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" released by "_copy_volume_from_snapshot" :: held 11.326s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3-b9b68339-3f43-410e-8f0e-19742296d6c1" released by "_create_volume_from_snapshot" :: held 11.424s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.459s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:58 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054235436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb7dd3-4435-4d0a-b627-1cf257049261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:57Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:58 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" returned: 0 in 0.563s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 1073741824 Sep 23 00:33:58 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4207ccf-36bc-4dd3-b834-0a68657e00e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b68339-3f43-410e-8f0e-19742296d6c1', 'volume_size': 1, 'snapshot_id': '55973d2e-da37-493e-8a8f-3adceb98e1f3'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18023456-21ae-441f-8b76-60e41072a383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c Sep 23 00:33:58 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Volume volume-b9b68339-3f43-410e-8f0e-19742296d6c1 (b9b68339-3f43-410e-8f0e-19742296d6c1): created successfully Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18023456-21ae-441f-8b76-60e41072a383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Flow 'volume_create_manager' (2a63aa02-8843-4337-9489-09a03adcb3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:58 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6e5f7ba8-b466-4686-a353-e814d54f5514 tempest-VolumeDependencyTests-89700287 None] Created volume successfully. Sep 23 00:33:58 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" returned: 0 in 0.354s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-50c23710-9ba7-42c0-b9d8-8d2dc52b863c" released by "delete_volume" :: held 1.075s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['a4796672-c398-4635-87cc-5969b95b4bc0', '09dab856-dd83-46a6-8b3f-430b59d91040', '8bb64142-91b5-483c-8beb-47c000bd8dc0', 'f304cd6c-cc07-4b02-b063-cc953cddd817'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:33:58 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 1073741824" returned: 0 in 0.612s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 Sep 23 00:33:58 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-2068f0dc-ee5c-4cab-a7d8-a626dce03d0b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-50c23710-9ba7-42c0-b9d8-8d2dc52b863c-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:59 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261" returned: 0 in 0.310s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f424912-5cd6-4410-9f1c-3f0eb7bf29ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfb7dd3-4435-4d0a-b627-1cf257049261', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708c3e43-367f-4b20-b8ec-61e88c66cc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:59 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 (ccfb7dd3-4435-4d0a-b627-1cf257049261): created successfully Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708c3e43-367f-4b20-b8ec-61e88c66cc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (51721223-3fd9-4e5f-9c3b-57b5ea4be779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1b6c69e4-9013-4b17-88d7-28da9eb57abb tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-55973d2e-da37-493e-8a8f-3adceb98e1f3-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-55973d2e-da37-493e-8a8f-3adceb98e1f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Deleting offline snapshot 55973d2e-da37-493e-8a8f-3adceb98e1f3 of volume 9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] snapshot_file for this snap is: volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650472e-00c2-4571-8cad-564c1a9461b6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:33:59 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "cinder-quobyte-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72dd498-40a2-4f03-b6f6-40d2390e9a31]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.434s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c80312d-8ae1-451e-a9b9-c7efce759d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:00 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c Sep 23 00:34:00 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01224e4-77c7-448a-978f-d7aed2507c90]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:34:00 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c Sep 23 00:34:00 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" returned: 0 in 0.351s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-quobyte-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c" released by "delete_volume" :: held 0.863s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:00 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.707s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating offline snapshot ceb8a843-5adb-4244-aae9-6902328d9291 of volume ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:00 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:34:00 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb3a3d4-f457-4514-9063-fc0dbae2216b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Created reservations ['4ce25537-4d65-40b6-863f-25225a9d2282', '770e7ac0-f26b-4e60-a0cf-07cc9f07348e', '32c706c3-e05b-4639-a8ac-1ff85da9a01b', '015b0e63-9fb7-49ed-bed8-f439e03cdea0'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 Sep 23 00:34:00 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:01 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.566s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261" returned: 0 in 0.529s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3 Sep 23 00:34:01 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 1G Sep 23 00:34:01 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Deleted volume successfully. Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aa7fa184-9ca7-42df-9425-ca956cdad02b tempest-CreateVolumesFromSourceVolumeTest-1183066631 None] Lock "cinder-f6a1c84c-d619-4505-aa37-b4e9cd8ba75c-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:01 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38.55973d2e-da37-493e-8a8f-3adceb98e1f3" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-55973d2e-da37-493e-8a8f-3adceb98e1f3" released by "_delete_snapshot" :: held 2.275s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" released by "delete_snapshot" :: held 2.303s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Created reservations ['e6d20e09-655f-4ec2-9155-76b733fc4cca', 'cc8e48a1-9381-41dc-95d4-ca54ae893684', '3af6b451-e61a-47b5-81c9-630f38c03eb2', 'e84f7054-15ff-4231-91b2-0a60c8142760'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:01 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 1G" returned: 0 in 0.618s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Delete snapshot completed successfully. Sep 23 00:34:01 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 Sep 23 00:34:01 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-28f68677-f57d-4bf1-8000-d189f3aff6ce tempest-VolumeDependencyTests-89700287 None] Lock "cinder-55973d2e-da37-493e-8a8f-3adceb98e1f3-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:02 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 is being set with open permissions: ugo+rw Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 Sep 23 00:34:02 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-9c80312d-8ae1-451e-a9b9-c7efce759d38-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291" returned: 0 in 0.376s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-9c80312d-8ae1-451e-a9b9-c7efce759d38-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info Sep 23 00:34:02 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02abebfe-ff06-40cd-8a50-e33c19842935]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:34:03 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info" returned: 0 in 0.416s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info is being set with open permissions: ugo+rw Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info Sep 23 00:34:03 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.489s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38 Sep 23 00:34:03 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.info" returned: 0 in 0.312s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-77e80c29-9db4-4f5a-bb38-5ebe7cff4c9f tempest-CreateVolumesFromSnapshotTest-698051827 None] Create snapshot completed successfully Sep 23 00:34:03 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-9c80312d-8ae1-451e-a9b9-c7efce759d38" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-9c80312d-8ae1-451e-a9b9-c7efce759d38" released by "delete_volume" :: held 0.955s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:03 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Created reservations ['41638091-1800-4cfb-91f7-af5b0b9223f6', '48e4ead8-b264-436c-bd6a-47ae01a01dd0', 'b2b371fd-f7a1-4393-bd53-cc42d6ab5411', '0e87bc9f-d161-4250-94f8-c168bfd0b647'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:04 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:04 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:04 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.465s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Deleted volume successfully. Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4eb87169-5d24-4e60-a910-a74a68097308 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-9c80312d-8ae1-451e-a9b9-c7efce759d38-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (866a75a5-f927-4019-8a01-9c7965f0ad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c84a1c-8489-4594-8264-25fe619973e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c84a1c-8489-4594-8264-25fe619973e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741829109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307eabaf-352f-4451-84f6-0a73e9da4df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2aaaf1-14a1-4f3c-9689-f57b8887074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2aaaf1-14a1-4f3c-9689-f57b8887074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf360a-2045-4b5c-a1df-e191fbe09d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf360a-2045-4b5c-a1df-e191fbe09d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307eabaf-352f-4451-84f6-0a73e9da4df4', 'volume_name': 'volume-307eabaf-352f-4451-84f6-0a73e9da4df4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bf5ea1-db62-4a67-8f1e-2a20389f37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bf5ea1-db62-4a67-8f1e-2a20389f37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984e954d-9aa4-44c6-8919-36887b0064c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume 307eabaf-352f-4451-84f6-0a73e9da4df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307eabaf-352f-4451-84f6-0a73e9da4df4', 'volume_size': 1} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741829109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307eabaf-352f-4451-84f6-0a73e9da4df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume 307eabaf-352f-4451-84f6-0a73e9da4df4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:04 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:04 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 1073741824 Sep 23 00:34:04 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-b9b68339-3f43-410e-8f0e-19742296d6c1-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-b9b68339-3f43-410e-8f0e-19742296d6c1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ce1a5-81b1-449c-891f-9cd6c18d3546]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:05 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 Sep 23 00:34:05 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (27eb31c1-e070-4dd5-9c68-c9f19c3aa53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d23dfb-4bf1-43df-920c-f12252e3988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d23dfb-4bf1-43df-920c-f12252e3988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248444936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d434a63-ebac-457f-b9e5-6e25598c4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df97814-5f60-49d3-80d2-6004fde46db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df97814-5f60-49d3-80d2-6004fde46db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca22240-103e-46c7-a8a0-61899ae5d008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca22240-103e-46c7-a8a0-61899ae5d008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d434a63-ebac-457f-b9e5-6e25598c4223', 'volume_name': 'volume-7d434a63-ebac-457f-b9e5-6e25598c4223', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b91a0f4-94da-42ee-8f84-1281f804bd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b91a0f4-94da-42ee-8f84-1281f804bd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca948f2-0b44-4d43-aabe-39ba392c6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume 7d434a63-ebac-457f-b9e5-6e25598c4223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d434a63-ebac-457f-b9e5-6e25598c4223', 'volume_size': 1} Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:05 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 1073741824" returned: 0 in 1.054s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:06 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 Sep 23 00:34:06 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1" returned: 0 in 0.886s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:06 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1 Sep 23 00:34:06 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (07e7c470-c03d-42db-905b-befbee11ab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a5637-d535-49e4-910d-fc368083164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a5637-d535-49e4-910d-fc368083164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248676697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27cecb-6daf-4341-8ac9-b162ea7ab93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc58e6-75c2-4857-b361-64e7890a6e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc58e6-75c2-4857-b361-64e7890a6e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61453ec6-e7ff-49c7-9f71-64327d4dd673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61453ec6-e7ff-49c7-9f71-64327d4dd673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de27cecb-6daf-4341-8ac9-b162ea7ab93a', 'volume_name': 'volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936fc43e-91d5-44f4-940c-24bb5ce19e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936fc43e-91d5-44f4-940c-24bb5ce19e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50952fdd-013e-4acc-b790-894c15403ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume de27cecb-6daf-4341-8ac9-b162ea7ab93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a', 'volume_size': 1} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b9b68339-3f43-410e-8f0e-19742296d6c1" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4" returned: 0 in 0.854s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1248444936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d434a63-ebac-457f-b9e5-6e25598c4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume 7d434a63-ebac-457f-b9e5-6e25598c4223 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:06 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984e954d-9aa4-44c6-8919-36887b0064c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307eabaf-352f-4451-84f6-0a73e9da4df4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:06 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 1073741824 Sep 23 00:34:06 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc30044-46f1-47dd-80d6-708360600097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:06 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-quobyte-b9b68339-3f43-410e-8f0e-19742296d6c1" released by "delete_volume" :: held 1.688s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-307eabaf-352f-4451-84f6-0a73e9da4df4 (307eabaf-352f-4451-84f6-0a73e9da4df4): created successfully Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc30044-46f1-47dd-80d6-708360600097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (866a75a5-f927-4019-8a01-9c7965f0ad3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-82da922b-e031-402b-8b72-b907fbc8cb3c tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (efd414e3-0b2d-4d44-b3cd-fba315e9122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39226ffb-be15-4028-a302-5563d5ae31c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39226ffb-be15-4028-a302-5563d5ae31c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673104685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8429a112-c9d9-4fc2-a77d-fa40255bf1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:07Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec397bc-6f16-4c96-b0d6-800bc7e0b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec397bc-6f16-4c96-b0d6-800bc7e0b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1460d977-9c8b-42ba-b682-8be681ea9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1460d977-9c8b-42ba-b682-8be681ea9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8429a112-c9d9-4fc2-a77d-fa40255bf1bd', 'volume_name': 'volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd17ed98-27fe-4512-849d-a204201c32b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd17ed98-27fe-4512-849d-a204201c32b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8508ca3c-9fba-49fa-aa40-63455a38bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:07 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume 8429a112-c9d9-4fc2-a77d-fa40255bf1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd', 'volume_size': 1} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Created reservations ['17968205-24b6-42f7-a525-620ca2b86e49', '89242a3e-7044-4d5a-a728-51407776f183', '1e5b845c-0b57-4fa9-a136-9ea25a0fb5bd', 'cb0e1f20-d14f-42ce-8f44-3e4bea39e6f4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:07 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:07 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:07 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 1073741824" returned: 0 in 0.802s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:07 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 Sep 23 00:34:07 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:07 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:07 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (f9387ec3-c477-4b4c-ac51-5a7103abe657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8120fa-dd73-463b-a4be-797fe4eb0265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Deleted volume successfully. Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8120fa-dd73-463b-a4be-797fe4eb0265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207748408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c696f5f-a272-4832-bdb8-a427e8b435ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c696f5f-a272-4832-bdb8-a427e8b435ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa9f7b3-ba82-4c19-80b0-5a5f3233d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa9f7b3-ba82-4c19-80b0-5a5f3233d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3', 'volume_name': 'volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d4fd5e-192a-4d6d-88d6-0e9c51de863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d4fd5e-192a-4d6d-88d6-0e9c51de863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea194ef-f50a-4a81-b8f5-9fb2602aa037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume 1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3', 'volume_size': 1} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a40815f2-be3f-434c-b9b5-e265040c49e3 tempest-VolumeDependencyTests-89700287 None] Lock "cinder-b9b68339-3f43-410e-8f0e-19742296d6c1-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:08 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248676697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27cecb-6daf-4341-8ac9-b162ea7ab93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:06Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume de27cecb-6daf-4341-8ac9-b162ea7ab93a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:08 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca948f2-0b44-4d43-aabe-39ba392c6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d434a63-ebac-457f-b9e5-6e25598c4223', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a 1073741824 Sep 23 00:34:08 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d149feb4-44f2-47a9-9c00-8bdd6eeddff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-7d434a63-ebac-457f-b9e5-6e25598c4223 (7d434a63-ebac-457f-b9e5-6e25598c4223): created successfully Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d149feb4-44f2-47a9-9c00-8bdd6eeddff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (27eb31c1-e070-4dd5-9c68-c9f19c3aa53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-82333e6f-91b5-4d51-ac9f-64f7ea9e72a4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Flow 'volume_create_manager' (e8b1f5ac-5ce5-43cd-888c-b91cd6ced6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72baac05-48d0-4d59-a250-beb10c7ed7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72baac05-48d0-4d59-a250-beb10c7ed7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e160ed-ea3d-47b0-9184-452d77ab67f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef12c10e1b6410db882ccd432993802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='ecad19ee327a47459b4b9568fd9d6786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe844cd-207a-4cf2-bc44-e82cf7a2cf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe844cd-207a-4cf2-bc44-e82cf7a2cf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfd0b0-2bb4-45b2-8c3e-6e8cdc8ee942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG cinder.image.glance [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Creating Keystone auth plugin from conf {{(pid=87132) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:34:08 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a 1073741824" returned: 0 in 0.682s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:08 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a Sep 23 00:34:08 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a" returned: 0 in 0.346s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673104685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8429a112-c9d9-4fc2-a77d-fa40255bf1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:07Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume 8429a112-c9d9-4fc2-a77d-fa40255bf1bd {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:09 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50952fdd-013e-4acc-b790-894c15403ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd 1073741824 Sep 23 00:34:09 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312caa10-21fd-44ce-9c85-419fb8616c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a (de27cecb-6daf-4341-8ac9-b162ea7ab93a): created successfully Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312caa10-21fd-44ce-9c85-419fb8616c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (07e7c470-c03d-42db-905b-befbee11ab69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-64974cff-96f2-4526-9bd9-f14ed5ca90e8 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfd0b0-2bb4-45b2-8c3e-6e8cdc8ee942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35e160ed-ea3d-47b0-9184-452d77ab67f3', 'volume_name': 'volume-35e160ed-ea3d-47b0-9184-452d77ab67f3', 'volume_size': 1, 'image_id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037f945da92a13aac72b4df45928eedc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ef12c10e1b6410db882ccd432993802', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '156c88b3758126cf4937c468c7499bbd4cda868a28674a9d7180d2f620f8a43106e726152b3a5c6c80bef568595977fa6f4d4636f7bad2cf5a50ecfa01ed4825', 'id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9384d34a-329d-4cdf-96db-b7a159bd62dd/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6439c5e-b7b1-49b0-bc0c-07c576917f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6439c5e-b7b1-49b0-bc0c-07c576917f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8642e49f-7b01-4d12-8d9e-3fc293ac9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Volume 35e160ed-ea3d-47b0-9184-452d77ab67f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35e160ed-ea3d-47b0-9184-452d77ab67f3', 'volume_size': 1, 'image_id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037f945da92a13aac72b4df45928eedc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ef12c10e1b6410db882ccd432993802', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '156c88b3758126cf4937c468c7499bbd4cda868a28674a9d7180d2f620f8a43106e726152b3a5c6c80bef568595977fa6f4d4636f7bad2cf5a50ecfa01ed4825', 'id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9384d34a-329d-4cdf-96db-b7a159bd62dd/file', 'properties': {}}, 'image_service': } Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Trying to clone 35e160ed-ea3d-47b0-9184-452d77ab67f3 from image 9384d34a-329d-4cdf-96db-b7a159bd62dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}]). {{(pid=87132) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:34:09 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fef804-2d47-463e-880f-94c5f06cf349]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:10 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd 1073741824" returned: 0 in 0.774s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd Sep 23 00:34:10 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" returned: 0 in 0.353s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207748408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf51991d56840d1864492d4dc405d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='017ca6a7334a4d2bb39a7e151a09fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Creating volume 1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8508ca3c-9fba-49fa-aa40-63455a38bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94488912-f955-4d58-acd9-4230fb8fe5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:10 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 1073741824 Sep 23 00:34:10 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd (8429a112-c9d9-4fc2-a77d-fa40255bf1bd): created successfully Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94488912-f955-4d58-acd9-4230fb8fe5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (efd414e3-0b2d-4d44-b3cd-fba315e9122c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5ae82b2a-51a4-40f9-8182-4b727066686d tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:34:11 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 1 in 0.669s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Temporary image 9384d34a-329d-4cdf-96db-b7a159bd62dd is fetched for user ecad19ee327a47459b4b9568fd9d6786. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a66f5-2771-4586-a4d6-87691eb38904]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 1073741824" returned: 0 in 0.744s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:11 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 Sep 23 00:34:11 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea194ef-f50a-4a81-b8f5-9fb2602aa037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bba95-dce2-4b80-97d1-f9e1fabb5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Volume volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 (1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3): created successfully Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bba95-dce2-4b80-97d1-f9e1fabb5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Flow 'volume_create_manager' (f9387ec3-c477-4b4c-ac51-5a7103abe657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-89fb0ddc-a197-4024-93f2-166da4023466 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created volume successfully. Sep 23 00:34:11 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:11 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e160ed-ea3d-47b0-9184-452d77ab67f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef12c10e1b6410db882ccd432993802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:08Z,use_quota=True,user_id='ecad19ee327a47459b4b9568fd9d6786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Creating volume 35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:12 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1073741824 Sep 23 00:34:12 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca06fd8-14fd-4d30-93ea-b3b75103b4e6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 Sep 23 00:34:12 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1073741824" returned: 0 in 0.701s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 Sep 23 00:34:12 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" returned: 0 in 0.549s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3 Sep 23 00:34:12 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Attempting download of 9384d34a-329d-4cdf-96db-b7a159bd62dd ((None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}])) to volume 35e160ed-ea3d-47b0-9184-452d77ab67f3. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:34:13 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3" released by "delete_volume" :: held 1.023s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1726bc-1399-41b5-9aed-7066b78aea00]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['282b6ffe-e382-4619-896a-5929ba3e7a81', 'caf04d77-245f-4129-8b59-db595d0671cc', '2bda8053-8ce6-4857-a2c0-06c501c512fd', '3b2d52b7-a3d0-4181-a515-9ac47b1c769e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:13 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm Sep 23 00:34:13 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:13 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm" returned: 0 in 0.538s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:14 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Flow 'volume_create_manager' (fdad0b77-7f90-41e1-b177-a7f0af505772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e82de9-1b48-43ba-b035-0adc87a4980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.384s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e82de9-1b48-43ba-b035-0adc87a4980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41de614-07f1-4fae-af11-77c5c6253fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f1a3c94b244eb596ec97f4fbcb9051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='fe852525b47640dc95c230489d8a6ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193959a-206f-4cf6-b25d-8ec2d6637c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193959a-206f-4cf6-b25d-8ec2d6637c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c599d1fc-13ab-4fdf-8db3-707d2f0aacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c599d1fc-13ab-4fdf-8db3-707d2f0aacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41de614-07f1-4fae-af11-77c5c6253fc4', 'volume_name': 'volume-c41de614-07f1-4fae-af11-77c5c6253fc4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc55620-5e2f-4d32-93f5-66be7135fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc55620-5e2f-4d32-93f5-66be7135fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1656031-b1ab-427a-91a8-4f49b5d73830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Volume c41de614-07f1-4fae-af11-77c5c6253fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41de614-07f1-4fae-af11-77c5c6253fc4', 'volume_size': 1} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41de614-07f1-4fae-af11-77c5c6253fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f1a3c94b244eb596ec97f4fbcb9051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:14Z,use_quota=True,user_id='fe852525b47640dc95c230489d8a6ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Creating volume c41de614-07f1-4fae-af11-77c5c6253fc4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:14 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:14 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm Sep 23 00:34:14 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 1073741824 Sep 23 00:34:14 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d2cbfd5b-3a51-40db-a491-a2a68a8872c4 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-1bbf02f5-2f1a-4307-8f6f-b6b84c8ae5c3-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:14 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm" returned: 1 in 0.518s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9384d34a-329d-4cdf-96db-b7a159bd62dd_rsom8acm' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f62da3f-ea09-4fd0-b516-63aac583a942]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-8429a112-c9d9-4fc2-a77d-fa40255bf1bd-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:14 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-8429a112-c9d9-4fc2-a77d-fa40255bf1bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756ed1f-19cc-477c-9408-6c79c1aa60ff]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 1073741824" returned: 0 in 0.766s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd Sep 23 00:34:14 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 Sep 23 00:34:15 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:15 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd Sep 23 00:34:15 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1656031-b1ab-427a-91a8-4f49b5d73830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41de614-07f1-4fae-af11-77c5c6253fc4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD Sep 23 00:34:15 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34803f84-1416-48cf-a87b-b32be2fc6935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Volume volume-c41de614-07f1-4fae-af11-77c5c6253fc4 (c41de614-07f1-4fae-af11-77c5c6253fc4): created successfully Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34803f84-1416-48cf-a87b-b32be2fc6935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Flow 'volume_create_manager' (fdad0b77-7f90-41e1-b177-a7f0af505772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:15 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3496b127-8d4b-4be6-9b3a-31c65b4a1f02 tempest-CinderUnicodeTest-889490243 None] Created volume successfully. Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Flow 'volume_create_manager' (a1f7782c-912c-48d9-9942-364833258146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b83dd9-9ec7-4e06-8d0d-c38c5a13e37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b83dd9-9ec7-4e06-8d0d-c38c5a13e37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302149543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59487bd8-3ee3-4223-897c-7ceba8601bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba87e9efd9244d2a16203eee4219103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:16Z,use_quota=True,user_id='241428b592ef45fc8375fd373cec825c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc5503c-35ce-42e1-aa95-8671b7b91a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc5503c-35ce-42e1-aa95-8671b7b91a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40b51c2-26cc-4ed8-8d4c-029aaf1962b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40b51c2-26cc-4ed8-8d4c-029aaf1962b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59487bd8-3ee3-4223-897c-7ceba8601bfa', 'volume_name': 'volume-59487bd8-3ee3-4223-897c-7ceba8601bfa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29506fa3-b3ec-496d-bbfd-e199101581e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29506fa3-b3ec-496d-bbfd-e199101581e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4c6f2f-8725-4086-907b-080fb4fbbc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:15 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Volume 59487bd8-3ee3-4223-897c-7ceba8601bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59487bd8-3ee3-4223-897c-7ceba8601bfa', 'volume_size': 1} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302149543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59487bd8-3ee3-4223-897c-7ceba8601bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba87e9efd9244d2a16203eee4219103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:16Z,use_quota=True,user_id='241428b592ef45fc8375fd373cec825c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Creating volume 59487bd8-3ee3-4223-897c-7ceba8601bfa {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:15 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD" returned: 1 in 0.677s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] 9384d34a-329d-4cdf-96db-b7a159bd62dd was raw, converting to qcow2 {{(pid=87132) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa 1073741824 Sep 23 00:34:15 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-8429a112-c9d9-4fc2-a77d-fa40255bf1bd" released by "delete_volume" :: held 1.097s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:15 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 Sep 23 00:34:15 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['35db35fb-b330-40f0-9148-ae7cd3dede1a', '025c5bf7-ed0f-430b-bb8e-a753c3d6c008', '1b12411b-7bbe-4bcc-ac77-8ff241299ca9', 'd319aef2-7474-4c54-9638-97c6a34e18c4'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:16 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:16 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:16 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa 1073741824" returned: 0 in 0.698s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-30928ce5-8669-45f8-a028-e4faa52707ac tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-8429a112-c9d9-4fc2-a77d-fa40255bf1bd-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3" returned: 0 in 0.745s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9384d34a-329d-4cdf-96db-b7a159bd62dd_7v68dqutdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:16 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa Sep 23 00:34:16 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1G Sep 23 00:34:16 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Flow 'volume_create_manager' (36e44369-9d39-40a5-83df-39c503ae2967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4b4631-8a34-4c3a-912c-01772b9c4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4b4631-8a34-4c3a-912c-01772b9c4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1346868319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8312de8-26c7-4e3b-95b8-4ec596ae32ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f1a3c94b244eb596ec97f4fbcb9051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:17Z,use_quota=True,user_id='fe852525b47640dc95c230489d8a6ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af71ed-d7de-47bb-9fc2-6b8e0558041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af71ed-d7de-47bb-9fc2-6b8e0558041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f233dc-5a1e-4d1c-8f70-e94491243563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f233dc-5a1e-4d1c-8f70-e94491243563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8312de8-26c7-4e3b-95b8-4ec596ae32ca', 'volume_name': 'volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:16 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934f3394-b05b-44a8-a366-59b3a877dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934f3394-b05b-44a8-a366-59b3a877dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcee6c6-f2e2-49c1-8a69-83b1c879d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:16 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Volume b8312de8-26c7-4e3b-95b8-4ec596ae32ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca', 'volume_size': 1} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa" returned: 0 in 0.311s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1346868319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8312de8-26c7-4e3b-95b8-4ec596ae32ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f1a3c94b244eb596ec97f4fbcb9051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:17Z,use_quota=True,user_id='fe852525b47640dc95c230489d8a6ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Creating volume b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:16 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-de27cecb-6daf-4341-8ac9-b162ea7ab93a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:16 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca 1073741824 Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4c6f2f-8725-4086-907b-080fb4fbbc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59487bd8-3ee3-4223-897c-7ceba8601bfa', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:16 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9095640b-f2f1-4312-9190-d7cf81d272e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-de27cecb-6daf-4341-8ac9-b162ea7ab93a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Volume volume-59487bd8-3ee3-4223-897c-7ceba8601bfa (59487bd8-3ee3-4223-897c-7ceba8601bfa): created successfully Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9095640b-f2f1-4312-9190-d7cf81d272e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Flow 'volume_create_manager' (a1f7782c-912c-48d9-9942-364833258146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f3f683f4-6708-407d-9771-94a6401e0572 tempest-ProjectReaderTests-1947230391 None] Created volume successfully. Sep 23 00:34:17 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 1G" returned: 0 in 0.495s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Downloaded image 9384d34a-329d-4cdf-96db-b7a159bd62dd ((None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}])) to volume 35e160ed-ea3d-47b0-9184-452d77ab67f3 successfully. {{(pid=87132) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Temporary image 9384d34a-329d-4cdf-96db-b7a159bd62dd for user ecad19ee327a47459b4b9568fd9d6786 is deleted. {{(pid=87132) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.volume_utils [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Marking volume 35e160ed-ea3d-47b0-9184-452d77ab67f3 as bootable. {{(pid=87132) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-de27cecb-6daf-4341-8ac9-b162ea7ab93a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Copying metadata from image 9384d34a-329d-4cdf-96db-b7a159bd62dd to 35e160ed-ea3d-47b0-9184-452d77ab67f3. {{(pid=87132) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Creating volume glance metadata for volume 35e160ed-ea3d-47b0-9184-452d77ab67f3 backed by image 9384d34a-329d-4cdf-96db-b7a159bd62dd with: {'image_id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '037f945da92a13aac72b4df45928eedc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87132) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-de27cecb-6daf-4341-8ac9-b162ea7ab93a" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aeab57-e68d-4fb9-ad72-7eb9227c6ad1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8642e49f-7b01-4d12-8d9e-3fc293ac9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e160ed-ea3d-47b0-9184-452d77ab67f3', 'volume_size': 1, 'image_id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9384d34a-329d-4cdf-96db-b7a159bd62dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037f945da92a13aac72b4df45928eedc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ef12c10e1b6410db882ccd432993802', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '156c88b3758126cf4937c468c7499bbd4cda868a28674a9d7180d2f620f8a43106e726152b3a5c6c80bef568595977fa6f4d4636f7bad2cf5a50ecfa01ed4825', 'id': '9384d34a-329d-4cdf-96db-b7a159bd62dd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9384d34a-329d-4cdf-96db-b7a159bd62dd/file', 'properties': {}}, 'image_service': }' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2545c588-6e4b-4b07-91e3-62a5cbe938df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Volume volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 (35e160ed-ea3d-47b0-9184-452d77ab67f3): created successfully Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2545c588-6e4b-4b07-91e3-62a5cbe938df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Flow 'volume_create_manager' (e8b1f5ac-5ce5-43cd-888c-b91cd6ced6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-36886eca-9c77-49e8-9089-c5df1eacd6f4 tempest-VolumeImageDependencyTests-412448471 None] Created volume successfully. Sep 23 00:34:17 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a Sep 23 00:34:17 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca 1073741824" returned: 0 in 0.634s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Acquiring lock "cinder-35e160ed-ea3d-47b0-9184-452d77ab67f3-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "cinder-35e160ed-ea3d-47b0-9184-452d77ab67f3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a" returned: 0 in 0.556s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Acquiring lock "cinder-quobyte-35e160ed-ea3d-47b0-9184-452d77ab67f3" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a Sep 23 00:34:17 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "cinder-quobyte-35e160ed-ea3d-47b0-9184-452d77ab67f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9d426-5069-4e65-8425-3910672f26e8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 Sep 23 00:34:17 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" returned: 0 in 0.465s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcee6c6-f2e2-49c1-8a69-83b1c879d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975df0ff-4e40-48b6-bc82-ecd8dcbf57fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Acquiring lock "cinder-59487bd8-3ee3-4223-897c-7ceba8601bfa-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Volume volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca (b8312de8-26c7-4e3b-95b8-4ec596ae32ca): created successfully Sep 23 00:34:18 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975df0ff-4e40-48b6-bc82-ecd8dcbf57fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Flow 'volume_create_manager' (36e44369-9d39-40a5-83df-39c503ae2967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-de27cecb-6daf-4341-8ac9-b162ea7ab93a" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "cinder-59487bd8-3ee3-4223-897c-7ceba8601bfa-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-de27cecb-6daf-4341-8ac9-b162ea7ab93a" released by "delete_volume" :: held 1.173s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e066ac2b-a3b7-459c-add2-302f1b5ee3da tempest-CinderUnicodeTest-889490243 None] Created volume successfully. Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Acquiring lock "cinder-quobyte-59487bd8-3ee3-4223-897c-7ceba8601bfa" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "cinder-quobyte-59487bd8-3ee3-4223-897c-7ceba8601bfa" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[9869e433-90e5-4934-b190-e1ca6c606e05]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['4e0e5a01-9b21-4372-b51f-5379663f413f', '70ad7c14-f55c-4782-b87c-5f62c3d2aa46', '7507bf40-31cf-445a-929d-6683eef8089d', 'a8748bfc-2e26-4cc3-b361-dea094364eba'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:18 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3" returned: 0 in 0.671s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3 Sep 23 00:34:18 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:18 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa Sep 23 00:34:18 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-35e160ed-ea3d-47b0-9184-452d77ab67f3" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "cinder-quobyte-35e160ed-ea3d-47b0-9184-452d77ab67f3" released by "delete_volume" :: held 1.074s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-d20c4922-d303-406d-98bd-d9fafb88a2ef tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-de27cecb-6daf-4341-8ac9-b162ea7ab93a-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Created reservations ['b5b6d07f-7e33-4e84-bf7f-4e23796cb9e4', 'ad9f7fa4-ea43-4654-8c4c-a91edc726b77', '55d982b9-4675-42b0-bb61-109049e85c97', '68102e9e-5f5d-4ec1-b494-7d649e4517ee'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:18 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa" returned: 0 in 0.567s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa Sep 23 00:34:19 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:19 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-7d434a63-ebac-457f-b9e5-6e25598c4223-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Deleted volume successfully. Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-59487bd8-3ee3-4223-897c-7ceba8601bfa" returned: 0 in 0.473s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-7d434a63-ebac-457f-b9e5-6e25598c4223-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "cinder-quobyte-59487bd8-3ee3-4223-897c-7ceba8601bfa" released by "delete_volume" :: held 1.121s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-0b5dfd72-451c-4f3d-a6ce-2d9da42e8e18 tempest-VolumeImageDependencyTests-412448471 None] Lock "cinder-35e160ed-ea3d-47b0-9184-452d77ab67f3-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Creating offline snapshot 7b159b04-1f07-41a6-a0c0-29df47cc35ba of volume b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c22da5a-6121-492b-9272-909696519a41]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-7d434a63-ebac-457f-b9e5-6e25598c4223" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-7d434a63-ebac-457f-b9e5-6e25598c4223" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba7df7-5125-4c4c-84e3-6c6fccf6ac11]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Created reservations ['712427fb-6d16-4df1-882d-a9ffb829d4c3', 'f3306cc5-07b4-494a-bb55-e492c42461c8', '3ec7de41-2fa2-4b5c-8a2b-fbb0770e76b1', '4971b71b-d8b0-414a-b4fe-e1d65f5e9323'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:19 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca Sep 23 00:34:19 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 Sep 23 00:34:19 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:19 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" returned: 0 in 0.576s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba 1G Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:20 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Deleted volume successfully. Sep 23 00:34:20 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223" returned: 0 in 0.565s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e71addca-f466-46bb-8121-c85bc2b3ee7e tempest-ProjectReaderTests-1947230391 None] Lock "cinder-59487bd8-3ee3-4223-897c-7ceba8601bfa-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:20 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223 Sep 23 00:34:20 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d434a63-ebac-457f-b9e5-6e25598c4223" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-7d434a63-ebac-457f-b9e5-6e25598c4223" released by "delete_volume" :: held 1.001s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['e8c8d3ec-11f4-4889-b3bf-1753ea82c9f9', '93d1bc91-c523-413f-8a6a-939ec85a8dd1', 'b9e87448-0971-474b-bf58-36f353dbedd7', '74369f1f-f065-4f8b-b538-a17882f31d7b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:20 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba 1G" returned: 0 in 0.754s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba Sep 23 00:34:21 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:21 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Flow 'volume_create_manager' (af6ebe56-ac37-480e-97b8-4a2976692e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7062e9-c469-448e-96d0-cdc78e53fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.497s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7062e9-c469-448e-96d0-cdc78e53fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380909238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad561e76-f468-4a2c-b9e2-6c4ca1a7545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba87e9efd9244d2a16203eee4219103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:21Z,use_quota=True,user_id='241428b592ef45fc8375fd373cec825c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7e96af-2d5b-4644-802f-551c6019d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7e96af-2d5b-4644-802f-551c6019d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94141357-6f7a-43d3-a04c-d355d6da1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94141357-6f7a-43d3-a04c-d355d6da1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad561e76-f468-4a2c-b9e2-6c4ca1a7545b', 'volume_name': 'volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22d10a-365d-4ad3-91b6-6e7f9ac18014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22d10a-365d-4ad3-91b6-6e7f9ac18014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e0c9d-7f48-4d36-b3fa-669c68a1f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Volume ad561e76-f468-4a2c-b9e2-6c4ca1a7545b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b', 'volume_size': 1} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba" returned: 0 in 0.531s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba is being set with open permissions: ugo+rw Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e7962627-c30a-4fe3-a9e0-5bf19afe7197 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-7d434a63-ebac-457f-b9e5-6e25598c4223-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:21 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba Sep 23 00:34:21 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-307eabaf-352f-4451-84f6-0a73e9da4df4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:21 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-307eabaf-352f-4451-84f6-0a73e9da4df4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=174,cinder:UPDATE=235,cinder:DELETE=23,cinder:INSERT=71 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=180,cinder:UPDATE=255,cinder:INSERT=58,cinder:DELETE=23 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-307eabaf-352f-4451-84f6-0a73e9da4df4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:21 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info Sep 23 00:34:21 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-307eabaf-352f-4451-84f6-0a73e9da4df4" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c7fed-a174-4842-b059-53454e7ff1ce]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 Sep 23 00:34:22 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info" returned: 0 in 0.414s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info is being set with open permissions: ugo+rw Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info Sep 23 00:34:22 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4" returned: 0 in 0.530s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4 Sep 23 00:34:22 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.info" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.110s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380909238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad561e76-f468-4a2c-b9e2-6c4ca1a7545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba87e9efd9244d2a16203eee4219103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:21Z,use_quota=True,user_id='241428b592ef45fc8375fd373cec825c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Creating volume ad561e76-f468-4a2c-b9e2-6c4ca1a7545b {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b 1073741824 Sep 23 00:34:22 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-19064941-5694-4d75-931b-4e33bd106ba8 tempest-CinderUnicodeTest-889490243 None] Create snapshot completed successfully Sep 23 00:34:22 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-307eabaf-352f-4451-84f6-0a73e9da4df4" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-307eabaf-352f-4451-84f6-0a73e9da4df4" released by "delete_volume" :: held 0.919s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:22 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['8a091569-4aa5-4fb5-8a8a-259d0843dabf', '93e26800-e267-40ff-8782-f44baa4556b3', '46202368-e720-4da2-b226-54050ab625ac', '2da8a51e-62b2-4f78-b9c8-0e8fa3b81bde'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:23 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b 1073741824" returned: 0 in 0.648s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-27d9bbd2-d0b0-4c6a-b6ef-f4a725be357d tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-307eabaf-352f-4451-84f6-0a73e9da4df4-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b Sep 23 00:34:23 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e0c9d-7f48-4d36-b3fa-669c68a1f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59ec149-0694-4c57-a6fc-b1ee147741df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Volume volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b (ad561e76-f468-4a2c-b9e2-6c4ca1a7545b): created successfully Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59ec149-0694-4c57-a6fc-b1ee147741df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Flow 'volume_create_manager' (af6ebe56-ac37-480e-97b8-4a2976692e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-7b159b04-1f07-41a6-a0c0-29df47cc35ba-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-1ee0b061-c098-495b-9d58-e515249b9a6d tempest-ProjectReaderTests-1947230391 None] Created volume successfully. Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-7b159b04-1f07-41a6-a0c0-29df47cc35ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-quobyte-7b159b04-1f07-41a6-a0c0-29df47cc35ba" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-7b159b04-1f07-41a6-a0c0-29df47cc35ba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Deleting offline snapshot 7b159b04-1f07-41a6-a0c0-29df47cc35ba of volume b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] snapshot_file for this snap is: volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47b4e1-847b-4361-a336-cf27e65b7395]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba Sep 23 00:34:24 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-ceb8a843-5adb-4244-aae9-6902328d9291-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-ceb8a843-5adb-4244-aae9-6902328d9291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-ceb8a843-5adb-4244-aae9-6902328d9291" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ceb8a843-5adb-4244-aae9-6902328d9291" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleting offline snapshot ceb8a843-5adb-4244-aae9-6902328d9291 of volume ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] snapshot_file for this snap is: volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433a35b-2e52-43a4-90ec-4ed62d450061]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 Sep 23 00:34:24 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba" returned: 0 in 0.561s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe699065-9c62-4af2-b36e-68b50b617194]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Acquiring lock "cinder-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "cinder-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Acquiring lock "cinder-quobyte-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "cinder-quobyte-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" acquired by "delete_volume" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[da472062-17d5-462b-94f1-2b77b3767513]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca Sep 23 00:34:24 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccfb7dd3-4435-4d0a-b627-1cf257049261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fbc725-b316-4bfd-8179-dfb9e56dccc6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b Sep 23 00:34:24 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 Sep 23 00:34:25 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" returned: 0 in 0.697s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" returned: 0 in 0.542s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba Sep 23 00:34:25 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b Sep 23 00:34:25 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261" returned: 0 in 0.536s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 Sep 23 00:34:25 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" returned: 0 in 0.300s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "cinder-quobyte-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b" released by "delete_volume" :: held 0.907s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Created reservations ['ad3ee9c6-0f83-49bc-b7ac-ad4a9c67d63c', 'ef9662b1-fab5-468b-a4ef-5c2efcf49a56', 'c4aca438-073e-40b1-a726-ad74a347cff9', '8b2ec237-3efc-4402-a615-7c46015b24e7'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:25 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba Sep 23 00:34:25 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:25 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291" returned: 0 in 0.537s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291 Sep 23 00:34:25 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca.7b159b04-1f07-41a6-a0c0-29df47cc35ba" returned: 0 in 0.490s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.511s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261.ceb8a843-5adb-4244-aae9-6902328d9291" returned: 0 in 0.407s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-7b159b04-1f07-41a6-a0c0-29df47cc35ba" released by "_delete_snapshot" :: held 2.467s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Deleted volume successfully. Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" released by "delete_snapshot" :: held 2.541s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ceb8a843-5adb-4244-aae9-6902328d9291" released by "_delete_snapshot" :: held 2.227s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-903219aa-dfde-4def-b77d-6cedc1ad8ac6 tempest-ProjectReaderTests-1947230391 None] Lock "cinder-ad561e76-f468-4a2c-b9e2-6c4ca1a7545b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" released by "delete_snapshot" :: held 2.259s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Created reservations ['b03615fc-0e72-43c7-8930-20bf866e76b6', 'affaadfe-d03a-4c0d-88d6-3186bfff94f1', 'd04ad557-2b5a-4fbc-9255-490bb21aac7b', 'd925ac2d-0bfe-4cee-b225-5db15375f278'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['36d07027-fa97-42d2-8ef3-89a77d88bf30', 'aaec3b3d-b82c-4791-a8e4-81fe79ceb3b7', '124e4e1e-9608-4004-a6d0-0b37c00517f2', '4d4b19ed-6589-4ebd-b401-6819cc6b5135'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Delete snapshot completed successfully. Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-29d27e9d-1698-43c5-9ba9-a181c20a8e5c tempest-CinderUnicodeTest-889490243 None] Lock "cinder-7b159b04-1f07-41a6-a0c0-29df47cc35ba-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:26 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Delete snapshot completed successfully. Sep 23 00:34:26 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ff114baa-dcaf-4104-9a03-19c60fc0b8d6 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-ceb8a843-5adb-4244-aae9-6902328d9291-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-b8312de8-26c7-4e3b-95b8-4ec596ae32ca-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "cinder-b8312de8-26c7-4e3b-95b8-4ec596ae32ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d75e7-c9a0-4470-93d0-a173c98f41bb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca Sep 23 00:34:27 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-ccfb7dd3-4435-4d0a-b627-1cf257049261-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-ccfb7dd3-4435-4d0a-b627-1cf257049261-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0ac0a-737c-4734-8414-01ad16191be1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 Sep 23 00:34:27 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" returned: 0 in 0.610s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca Sep 23 00:34:27 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261" returned: 0 in 0.540s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" returned: 0 in 0.369s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261 Sep 23 00:34:28 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-b8312de8-26c7-4e3b-95b8-4ec596ae32ca" released by "delete_volume" :: held 1.076s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Created reservations ['8ef81981-35fd-4598-9a2b-5008e3174334', '11b6fce1-bb42-4dc0-aafb-9609608190c7', '0d725c4b-d5ac-4537-8846-2a070d3267f3', '5a35dc2b-e12a-45aa-ade6-d2e89fc1bd40'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:28 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-ccfb7dd3-4435-4d0a-b627-1cf257049261" returned: 0 in 0.423s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-quobyte-ccfb7dd3-4435-4d0a-b627-1cf257049261" released by "delete_volume" :: held 1.118s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Created reservations ['0a73e150-89c0-4cfa-acb9-e04020c959a7', '7856e893-aec3-49b7-a08d-d5802eed0a41', '76ea315d-ec78-41e1-9add-543239f89198', '9c78afb4-4e3e-47c8-bf47-89f7c2189d0f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.422s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Deleted volume successfully. Sep 23 00:34:28 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:28 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-37c8039b-3f53-4ad9-a743-da3410267d3d tempest-CinderUnicodeTest-889490243 None] Lock "cinder-b8312de8-26c7-4e3b-95b8-4ec596ae32ca-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:29 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.355s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:29 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Deleted volume successfully. Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-aea32572-8c02-4246-8648-df52b70780f5 tempest-CreateVolumesFromSnapshotTest-698051827 None] Lock "cinder-ccfb7dd3-4435-4d0a-b627-1cf257049261-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-c41de614-07f1-4fae-af11-77c5c6253fc4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "cinder-c41de614-07f1-4fae-af11-77c5c6253fc4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "cinder-quobyte-c41de614-07f1-4fae-af11-77c5c6253fc4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-c41de614-07f1-4fae-af11-77c5c6253fc4" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08a7c3-76c9-4cdf-9ecc-7703b526a4f9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:29 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 Sep 23 00:34:29 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:30 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4" returned: 0 in 0.529s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:30 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4 Sep 23 00:34:30 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:30 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c41de614-07f1-4fae-af11-77c5c6253fc4" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "cinder-quobyte-c41de614-07f1-4fae-af11-77c5c6253fc4" released by "delete_volume" :: held 0.915s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Created reservations ['efc5ac55-0878-43ed-a3b4-f641105a2a9d', '00148209-2a53-4482-bfb3-41f8f48e8ff7', '3b788699-8699-4705-931c-4122795c7a98', '2d13dd88-b2fd-4490-8050-0d0681aafa59'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:30 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:30 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:30 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.336s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:30 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Deleted volume successfully. Sep 23 00:34:30 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-fe32ca8e-1a02-4e80-b9ee-92d6b86b1c74 tempest-CinderUnicodeTest-889490243 None] Lock "cinder-c41de614-07f1-4fae-af11-77c5c6253fc4-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (ddf3aa21-be48-4344-bd18-3176cbd53e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed2a29-1ecc-44a6-800b-7033b7f6b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed2a29-1ecc-44a6-800b-7033b7f6b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658140405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa84e14-de2e-4309-b39e-782698e95c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:34Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ce7b6-a1b9-4f24-b028-289c39574484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0ce7b6-a1b9-4f24-b028-289c39574484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086266be-12ec-4cf9-b61d-390238036c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086266be-12ec-4cf9-b61d-390238036c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa84e14-de2e-4309-b39e-782698e95c66', 'volume_name': 'volume-5fa84e14-de2e-4309-b39e-782698e95c66', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69883e6-b740-4a8b-846a-58d8d7850a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69883e6-b740-4a8b-846a-58d8d7850a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc0cc4-cf77-4ca1-91b3-fea564e023e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Volume 5fa84e14-de2e-4309-b39e-782698e95c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa84e14-de2e-4309-b39e-782698e95c66', 'volume_size': 1} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658140405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa84e14-de2e-4309-b39e-782698e95c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:34Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Creating volume 5fa84e14-de2e-4309-b39e-782698e95c66 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:33 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 1073741824 Sep 23 00:34:33 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 1073741824" returned: 0 in 0.602s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:34 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 Sep 23 00:34:34 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc0cc4-cf77-4ca1-91b3-fea564e023e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa84e14-de2e-4309-b39e-782698e95c66', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9fbcb2-4248-4dfd-bf7d-1bb83c8be3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Volume volume-5fa84e14-de2e-4309-b39e-782698e95c66 (5fa84e14-de2e-4309-b39e-782698e95c66): created successfully Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9fbcb2-4248-4dfd-bf7d-1bb83c8be3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (ddf3aa21-be48-4344-bd18-3176cbd53e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fc5b49ce-9634-456b-8f88-20b86285a919 tempest-ProjectReaderTests-1526731078 None] Created volume successfully. Sep 23 00:34:35 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f3310c00-33ab-43b2-9e65-01067f7b4e17 tempest-ProjectAdminTests-951731772 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87132) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-5fa84e14-de2e-4309-b39e-782698e95c66-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-5fa84e14-de2e-4309-b39e-782698e95c66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-quobyte-5fa84e14-de2e-4309-b39e-782698e95c66" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-5fa84e14-de2e-4309-b39e-782698e95c66" acquired by "delete_volume" :: waited 0.027s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3480a-0261-49f9-af06-80e14a2202b9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 Sep 23 00:34:36 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66 Sep 23 00:34:36 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-5fa84e14-de2e-4309-b39e-782698e95c66" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-5fa84e14-de2e-4309-b39e-782698e95c66" released by "delete_volume" :: held 0.874s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Created reservations ['10af4591-6547-4109-af18-80fa24bd30dc', '946806d1-53f0-4dbf-902a-ae9d5b77a8f4', '59be1d37-0c07-4499-84ec-b392efccd854', '7b59dd97-d528-4ae2-b62b-5214b5349796'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:37 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Deleted volume successfully. Sep 23 00:34:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e694a38f-2af2-494f-b46a-6dec28bfe6d4 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-5fa84e14-de2e-4309-b39e-782698e95c66-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (244dd700-c428-47b6-ab47-d78943baef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4d9c26-b7e3-46ed-95bd-a0a8e36ee73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4d9c26-b7e3-46ed-95bd-a0a8e36ee73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852136014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30596355-8dac-4bd9-b3e0-a32171d5d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:38Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abad3e9-4c2d-4a00-80d2-64a3122f3f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abad3e9-4c2d-4a00-80d2-64a3122f3f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd03ebfd-63c4-4814-887e-2127ebe3ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd03ebfd-63c4-4814-887e-2127ebe3ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30596355-8dac-4bd9-b3e0-a32171d5d37a', 'volume_name': 'volume-30596355-8dac-4bd9-b3e0-a32171d5d37a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5595d1-5a26-4d8d-99fa-953b916cf52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5595d1-5a26-4d8d-99fa-953b916cf52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7315f9af-686e-4b56-90d2-d8840ab80338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Volume 30596355-8dac-4bd9-b3e0-a32171d5d37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30596355-8dac-4bd9-b3e0-a32171d5d37a', 'volume_size': 1} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852136014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30596355-8dac-4bd9-b3e0-a32171d5d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:38Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Creating volume 30596355-8dac-4bd9-b3e0-a32171d5d37a {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a 1073741824 Sep 23 00:34:38 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a 1073741824" returned: 0 in 0.637s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a Sep 23 00:34:39 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7315f9af-686e-4b56-90d2-d8840ab80338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30596355-8dac-4bd9-b3e0-a32171d5d37a', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d33c65c-8822-471d-b54b-9d0e8118f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Volume volume-30596355-8dac-4bd9-b3e0-a32171d5d37a (30596355-8dac-4bd9-b3e0-a32171d5d37a): created successfully Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d33c65c-8822-471d-b54b-9d0e8118f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (244dd700-c428-47b6-ab47-d78943baef02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-dfc6ae3e-b929-4b78-ad95-43f1acf2dcfc tempest-ProjectReaderTests-1526731078 None] Created volume successfully. Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-30596355-8dac-4bd9-b3e0-a32171d5d37a-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "cinder-30596355-8dac-4bd9-b3e0-a32171d5d37a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-quobyte-30596355-8dac-4bd9-b3e0-a32171d5d37a" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-30596355-8dac-4bd9-b3e0-a32171d5d37a" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffe0bb-0b6a-4174-a563-b3fe6a454915]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a Sep 23 00:34:40 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a" returned: 0 in 0.620s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a Sep 23 00:34:41 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-30596355-8dac-4bd9-b3e0-a32171d5d37a" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-30596355-8dac-4bd9-b3e0-a32171d5d37a" released by "delete_volume" :: held 1.044s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Created reservations ['ff58735a-b3e0-4c20-a036-675ce0fc8943', '5b14bcf7-7931-41c6-828d-25911597bb14', '7016bbda-dec1-4656-8cfa-7215132f203d', '6bb7086c-7f39-4268-9e65-6dbde531051e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:41 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.431s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Deleted volume successfully. Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-820f9a8e-e6fa-4fe1-8302-841b9fec609c tempest-ProjectReaderTests-1526731078 None] Lock "cinder-30596355-8dac-4bd9-b3e0-a32171d5d37a-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (b3563471-ba22-4b0c-a91e-0689ab1c9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2547ea0-dfbf-43c4-8128-e05a066e8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2547ea0-dfbf-43c4-8128-e05a066e8704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466857501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690167aa-ae41-4207-a071-dca9d05465a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:42Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06930dc-0939-4f24-8592-fe901f06e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06930dc-0939-4f24-8592-fe901f06e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6962bfc-1d17-4212-b999-f2fb39e6ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6962bfc-1d17-4212-b999-f2fb39e6ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690167aa-ae41-4207-a071-dca9d05465a9', 'volume_name': 'volume-690167aa-ae41-4207-a071-dca9d05465a9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff982df-7bbe-4300-b092-3f9cc7308de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff982df-7bbe-4300-b092-3f9cc7308de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643987fb-764f-47a0-82e8-c45a6dae5f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:42 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Volume 690167aa-ae41-4207-a071-dca9d05465a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690167aa-ae41-4207-a071-dca9d05465a9', 'volume_size': 1} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-466857501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690167aa-ae41-4207-a071-dca9d05465a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:42Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Creating volume 690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:42 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 1073741824 Sep 23 00:34:42 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 1073741824" returned: 0 in 0.832s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 Sep 23 00:34:43 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (5f806a94-b395-432d-8202-2d12089cd1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4eb819-c671-4fab-802a-1ed5efe346db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4eb819-c671-4fab-802a-1ed5efe346db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171779803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9131ed-dbd3-4f36-aa5f-fe8dafd072be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a77a07-95de-494a-9db2-b8da573bf5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a77a07-95de-494a-9db2-b8da573bf5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94275a32-789a-43e8-a0cb-7506eeef3d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94275a32-789a-43e8-a0cb-7506eeef3d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9131ed-dbd3-4f36-aa5f-fe8dafd072be', 'volume_name': 'volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b6fbd-999a-45ca-bbe6-acffd98f1255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7b6fbd-999a-45ca-bbe6-acffd98f1255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7903dd-189f-4fb4-96c9-1e7b0fe4b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Volume 7d9131ed-dbd3-4f36-aa5f-fe8dafd072be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be', 'volume_size': 1} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:43 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9" returned: 0 in 0.424s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171779803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9131ed-dbd3-4f36-aa5f-fe8dafd072be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:44Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Creating volume 7d9131ed-dbd3-4f36-aa5f-fe8dafd072be {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be 1073741824 Sep 23 00:34:43 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643987fb-764f-47a0-82e8-c45a6dae5f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690167aa-ae41-4207-a071-dca9d05465a9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ffd245-fb6a-45f8-9097-df88b583be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Volume volume-690167aa-ae41-4207-a071-dca9d05465a9 (690167aa-ae41-4207-a071-dca9d05465a9): created successfully Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ffd245-fb6a-45f8-9097-df88b583be9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (b3563471-ba22-4b0c-a91e-0689ab1c9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:44 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d42e87b2-8e0f-40f8-8bea-7601e8a4e6bf tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:34:44 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be 1073741824" returned: 0 in 0.801s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:44 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be Sep 23 00:34:44 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7903dd-189f-4fb4-96c9-1e7b0fe4b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c44d86-b654-4559-9395-92f098fafd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:45 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Volume volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be (7d9131ed-dbd3-4f36-aa5f-fe8dafd072be): created successfully Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c44d86-b654-4559-9395-92f098fafd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (5f806a94-b395-432d-8202-2d12089cd1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f444cdd-59fc-41fd-a22d-b3e51cdc69e5 tempest-ProjectReaderTests-1526731078 None] Created volume successfully. Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Creating offline snapshot d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 of volume 690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[4151027f-3ccd-4141-9042-6d005754c4c4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 Sep 23 00:34:45 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-quobyte-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" acquired by "delete_volume" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 1G Sep 23 00:34:45 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6286d76-d93c-4b63-9a95-226647ffae9b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be Sep 23 00:34:46 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" returned: 0 in 0.480s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 1G" returned: 0 in 0.541s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690167aa-ae41-4207-a071-dca9d05465a9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be Sep 23 00:34:46 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690167aa-ae41-4207-a071-dca9d05465a9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 Sep 23 00:34:46 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" returned: 0 in 0.297s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be" released by "delete_volume" :: held 0.826s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:46 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690167aa-ae41-4207-a071-dca9d05465a9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 is being set with open permissions: ugo+rw Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Created reservations ['25c23aed-3850-4bfc-bc26-fbeed77b8fc6', '119bdecc-7344-46e0-a50c-d89f609a90c5', '42da5168-bc98-40ef-8339-0a459fac4819', '7cd2d710-2a92-472a-bf41-171880668044'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:46 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 Sep 23 00:34:46 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:46 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" returned: 0 in 0.332s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info Sep 23 00:34:47 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Deleted volume successfully. Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-de9018f3-ba01-46e3-8220-e68179c924a8 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-7d9131ed-dbd3-4f36-aa5f-fe8dafd072be-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info is being set with open permissions: ugo+rw Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info Sep 23 00:34:47 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (c0d73c00-f810-48e9-b4f1-7ad0e34c2c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a48e28-bf8b-4f09-8f75-7081c70e1e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a48e28-bf8b-4f09-8f75-7081c70e1e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558112686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e1f9d3-a7eb-4a8f-b04f-74b13683ea37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afb6a28-5896-46f0-87de-b166079af85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afb6a28-5896-46f0-87de-b166079af85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e9a8f-e9e9-48f1-94d2-27a8eb3e2563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5e9a8f-e9e9-48f1-94d2-27a8eb3e2563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e1f9d3-a7eb-4a8f-b04f-74b13683ea37', 'volume_name': 'volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035a6ef9-afd6-45a5-95aa-8edff8b83c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035a6ef9-afd6-45a5-95aa-8edff8b83c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc17595-652e-4ef2-880b-0aef85071e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Volume 37e1f9d3-a7eb-4a8f-b04f-74b13683ea37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37', 'volume_size': 1} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:47 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.info" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558112686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e1f9d3-a7eb-4a8f-b04f-74b13683ea37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f97196da654b208e89a122bc348d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:48Z,use_quota=True,user_id='50e01faef2644a728146be7b6fe079a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Creating volume 37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 1073741824 Sep 23 00:34:47 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-50365ca7-3007-4e6f-81af-89aeb5c7e9a0 tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:34:48 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 1073741824" returned: 0 in 0.496s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 Sep 23 00:34:48 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 of volume 690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:48 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfcdf6-a0dc-4be3-a6a3-4772456239d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc17595-652e-4ef2-880b-0aef85071e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f03a8-c364-473f-9502-ed6e4e6bc4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Volume volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 (37e1f9d3-a7eb-4a8f-b04f-74b13683ea37): created successfully Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f03a8-c364-473f-9502-ed6e4e6bc4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Flow 'volume_create_manager' (c0d73c00-f810-48e9-b4f1-7ad0e34c2c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-f7c75eee-89e6-43aa-a1b9-95a12e4b4410 tempest-ProjectReaderTests-1526731078 None] Created volume successfully. Sep 23 00:34:48 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 Sep 23 00:34:48 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:49 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-690167aa-ae41-4207-a071-dca9d05465a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85fc12-56ff-492e-8280-7a0155db599d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 Sep 23 00:34:49 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:49 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9" returned: 0 in 0.375s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 Sep 23 00:34:49 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "cinder-quobyte-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:49 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085 Sep 23 00:34:49 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7c089-e2a6-4e3f-9d7b-22c52df77cdc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:49 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:50 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 Sep 23 00:34:50 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:50 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9.d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" returned: 0 in 0.303s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085" released by "_delete_snapshot" :: held 1.628s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" released by "delete_snapshot" :: held 1.655s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:50 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Created reservations ['f273e82f-845c-45ef-9b26-9e66c9a63a04', 'b1c2f59c-5610-47a5-a1f0-f157dc0d8915', '228665d9-0fb2-461b-99e3-29253888153e', '005650be-8650-4a69-9aad-dbf9871c875e'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:50 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" returned: 0 in 0.468s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:34:50 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37 Sep 23 00:34:50 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-07901ef8-7e28-4d8e-867a-6c32ab3f6418 tempest-ProjectMemberTests-667315727 None] Lock "cinder-d24ce499-3ac8-4d3e-8e95-6a5b92ad5085-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:50 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-quobyte-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37" released by "delete_volume" :: held 0.860s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-690167aa-ae41-4207-a071-dca9d05465a9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "cinder-690167aa-ae41-4207-a071-dca9d05465a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Created reservations ['7f904038-2d18-49c3-b492-7391c6bbaf7f', '22bf8446-d6d5-44ed-8ff1-9b5921edfb44', '22442c28-b1ad-47b7-9747-e90f8abd7d0d', 'cf9034b0-8ad6-4c91-84e1-67b5b50c36c9'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" acquired by "delete_volume" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab27a9-af2c-4bbf-afe5-9357c5e8aae7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:50 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:51 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:51 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 Sep 23 00:34:51 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:51 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Deleted volume successfully. Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-36f33b4e-1c76-4000-ad87-57d3b95603d7 tempest-ProjectReaderTests-1526731078 None] Lock "cinder-37e1f9d3-a7eb-4a8f-b04f-74b13683ea37-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:51 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:51 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9 Sep 23 00:34:51 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:51 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-690167aa-ae41-4207-a071-dca9d05465a9" returned: 0 in 0.286s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-690167aa-ae41-4207-a071-dca9d05465a9" released by "delete_volume" :: held 0.831s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Created reservations ['4263b065-f433-4595-a51a-41ab6b80119f', '400a8628-1963-4ae2-9296-eb12affb8cdc', 'bbc0d341-c5c0-4641-a2e6-c0251ec22a48', '305a51ea-d288-41e1-9d12-49aef0365be2'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:51 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:34:51 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:52 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-a13ce19b-1a62-47df-af8c-4ac8c502aac7 tempest-ProjectMemberTests-667315727 None] Lock "cinder-690167aa-ae41-4207-a071-dca9d05465a9-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (5bb5176f-410f-4655-8fba-133edb3ba502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24848fb9-88ad-49e4-8bc5-b2a1fee94e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24848fb9-88ad-49e4-8bc5-b2a1fee94e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436105953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701d1510-b4a9-4bb7-881f-7247f3e5dba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:53Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbc8658-059b-4a47-b9ac-20385d5466dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbc8658-059b-4a47-b9ac-20385d5466dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff6665-1b9f-4d42-bd6d-cbadd7bae516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff6665-1b9f-4d42-bd6d-cbadd7bae516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701d1510-b4a9-4bb7-881f-7247f3e5dba4', 'volume_name': 'volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72015adb-f5da-4275-8701-652469b6a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72015adb-f5da-4275-8701-652469b6a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7423c0e8-cfeb-4896-af6b-99289098235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Volume 701d1510-b4a9-4bb7-881f-7247f3e5dba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4', 'volume_size': 1} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436105953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701d1510-b4a9-4bb7-881f-7247f3e5dba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:53Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Creating volume 701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:52 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:34:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:52 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 1073741824 Sep 23 00:34:52 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:53 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 1073741824" returned: 0 in 0.603s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:53 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 Sep 23 00:34:53 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:53 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7423c0e8-cfeb-4896-af6b-99289098235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ed4708-0b43-4cb7-913d-95395ad4c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Volume volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 (701d1510-b4a9-4bb7-881f-7247f3e5dba4): created successfully Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ed4708-0b43-4cb7-913d-95395ad4c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (5bb5176f-410f-4655-8fba-133edb3ba502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8dcec094-edc3-4557-a712-0dd6bc095c3a tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Creating offline snapshot 10cd240a-170c-4a4c-a797-39c60b2b42a0 of volume 701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab667fb-faad-4519-a6da-e1852e9ba659]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:55 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 Sep 23 00:34:55 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:55 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:55 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 1G Sep 23 00:34:55 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:55 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 1G" returned: 0 in 0.488s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 Sep 23 00:34:56 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:56 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0" returned: 0 in 0.378s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 is being set with open permissions: ugo+rw Sep 23 00:34:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 Sep 23 00:34:56 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:56 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info Sep 23 00:34:56 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:57 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:57 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info is being set with open permissions: ugo+rw Sep 23 00:34:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:57 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info Sep 23 00:34:57 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:57 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.info" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:57 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-91cb7e19-ea79-46ad-b772-fde40fac5bde tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-10cd240a-170c-4a4c-a797-39c60b2b42a0-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-10cd240a-170c-4a4c-a797-39c60b2b42a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-10cd240a-170c-4a4c-a797-39c60b2b42a0" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-10cd240a-170c-4a4c-a797-39c60b2b42a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot 10cd240a-170c-4a4c-a797-39c60b2b42a0 of volume 701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e73aff0-7be4-4af5-b76a-10de98a4e750]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:58 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 Sep 23 00:34:58 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:58 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0" returned: 0 in 0.404s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb731f0-e5c9-4350-ade5-b3680213d297]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:58 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 Sep 23 00:34:58 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:59 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4" returned: 0 in 0.471s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:59 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 Sep 23 00:34:59 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:59 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0" returned: 0 in 0.498s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:59 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0 Sep 23 00:34:59 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:59 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4.10cd240a-170c-4a4c-a797-39c60b2b42a0" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-10cd240a-170c-4a4c-a797-39c60b2b42a0" released by "_delete_snapshot" :: held 1.817s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" released by "delete_snapshot" :: held 1.844s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Created reservations ['31f75311-7ea1-4c71-9f24-8bb242ea7646', 'd30c9883-4cba-4fce-966c-b960185b5983', 'eb6fea6b-2e23-45f6-a017-ea38ce5e0977', 'd810ee33-5a28-4c7d-8101-4b0cc3eb704a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-6aafd550-2b94-4bff-a180-dc7dbc1d6def tempest-ProjectMemberTests-667315727 None] Lock "cinder-10cd240a-170c-4a4c-a797-39c60b2b42a0-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-701d1510-b4a9-4bb7-881f-7247f3e5dba4-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "cinder-701d1510-b4a9-4bb7-881f-7247f3e5dba4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" acquired by "delete_volume" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[657fc132-f056-4ead-8be3-7e528f2f42d0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:01 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 Sep 23 00:35:01 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:02 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4" returned: 0 in 0.448s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:02 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4 Sep 23 00:35:02 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:02 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-701d1510-b4a9-4bb7-881f-7247f3e5dba4" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-701d1510-b4a9-4bb7-881f-7247f3e5dba4" released by "delete_volume" :: held 0.855s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Created reservations ['06dbdcb0-16dd-4820-8135-a40810d6babc', '741b6aa4-641c-4e2d-850b-05b1121bf236', '512cbd52-1992-4e80-8e55-66674d7a3f78', '97cd850d-898e-445d-ba7b-3cfb89fcf94d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:02 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:02 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:03 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.352s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:03 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-15762337-5735-4b0b-8918-70bd74ee9cdf tempest-ProjectMemberTests-667315727 None] Lock "cinder-701d1510-b4a9-4bb7-881f-7247f3e5dba4-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (a67a8af1-8304-4a5a-b681-f1d6768d413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008cc2ae-f557-4a51-8c87-d6ea87801669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008cc2ae-f557-4a51-8c87-d6ea87801669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-343737438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f22091c-0bd3-4cb4-b9ab-c4603a3f6732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:04Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fcd00c-ab01-4db0-8754-06d03b46a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fcd00c-ab01-4db0-8754-06d03b46a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9457b5-8683-4272-8f7f-79e33df8c8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9457b5-8683-4272-8f7f-79e33df8c8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f22091c-0bd3-4cb4-b9ab-c4603a3f6732', 'volume_name': 'volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad6b471-bfed-43a3-843c-96b6bfbefa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad6b471-bfed-43a3-843c-96b6bfbefa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67278bd-9e65-4223-8064-d5553b04cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:03 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Volume 6f22091c-0bd3-4cb4-b9ab-c4603a3f6732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732', 'volume_size': 1} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-343737438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f22091c-0bd3-4cb4-b9ab-c4603a3f6732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:04Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Creating volume 6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:03 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:03 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 1073741824 Sep 23 00:35:03 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:04 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 1073741824" returned: 0 in 0.585s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:04 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 Sep 23 00:35:04 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:04 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67278bd-9e65-4223-8064-d5553b04cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba14a89-696a-49fd-934c-99592b9ae465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:04 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Volume volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 (6f22091c-0bd3-4cb4-b9ab-c4603a3f6732): created successfully Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba14a89-696a-49fd-934c-99592b9ae465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:04 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (a67a8af1-8304-4a5a-b681-f1d6768d413e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3ae6e09c-3d8d-4cc8-b89c-934aec12d299 tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:35:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Creating offline snapshot fa600f24-ef41-42e0-bed0-b06502ed0c16 of volume 6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8d7b4-18a1-4ab3-9f04-9449baa65603]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:06 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 Sep 23 00:35:06 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:06 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" returned: 0 in 0.474s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:06 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 1G Sep 23 00:35:06 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:06 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 1G" returned: 0 in 0.443s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:06 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 Sep 23 00:35:06 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:07 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16" returned: 0 in 0.325s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 is being set with open permissions: ugo+rw Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:07 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 Sep 23 00:35:07 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:07 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:07 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info Sep 23 00:35:07 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:07 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info" returned: 0 in 0.309s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:07 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info is being set with open permissions: ugo+rw Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:07 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info Sep 23 00:35:07 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:07 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.info" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-49b46af2-5856-419a-8d3a-9a663d90cb7c tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:35:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-fa600f24-ef41-42e0-bed0-b06502ed0c16-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-fa600f24-ef41-42e0-bed0-b06502ed0c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-fa600f24-ef41-42e0-bed0-b06502ed0c16" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-fa600f24-ef41-42e0-bed0-b06502ed0c16" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot fa600f24-ef41-42e0-bed0-b06502ed0c16 of volume 6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce923bf-6743-4c1a-b874-151b90eeb8a7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:09 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 Sep 23 00:35:09 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:09 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15a414-8969-4997-bec2-dc8abd2252e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:09 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 Sep 23 00:35:09 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:09 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" returned: 0 in 0.436s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:09 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 Sep 23 00:35:10 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:10 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16" returned: 0 in 0.395s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:10 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16 Sep 23 00:35:10 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:10 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732.fa600f24-ef41-42e0-bed0-b06502ed0c16" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-fa600f24-ef41-42e0-bed0-b06502ed0c16" released by "_delete_snapshot" :: held 1.663s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" released by "delete_snapshot" :: held 1.694s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Created reservations ['d5aa5d19-9459-43b2-b9eb-e9a63e092ef5', '0b1e2804-8d6e-48db-ac5b-86a708721044', '3c16e644-5afb-4781-8ce7-896ef144eeef', 'ff2372bb-3f08-4fc4-8223-9e7e4004183a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:10 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:10 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9aae4d29-e7b4-4b7c-ab52-b4835a8a6287 tempest-ProjectMemberTests-667315727 None] Lock "cinder-fa600f24-ef41-42e0-bed0-b06502ed0c16-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "cinder-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" acquired by "delete_volume" :: waited 0.037s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c571f41-5055-4af4-9f33-aa6330a46207]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:11 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 Sep 23 00:35:11 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:11 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:11 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732 Sep 23 00:35:11 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:12 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" returned: 0 in 0.308s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732" released by "delete_volume" :: held 0.856s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Created reservations ['bf3849e9-c377-4ebe-a189-769e362adca2', '7f650dc6-cd9c-47ef-bd6a-b59957ab4d1e', '492b5fdb-b307-4771-90ec-3600d91be07d', '1fb2f778-2bae-40a4-9d83-87a1212387bc'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:12 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:12 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:12 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.377s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:12 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-026dc39e-ca1d-4c16-9660-a30633c4dae4 tempest-ProjectMemberTests-667315727 None] Lock "cinder-6f22091c-0bd3-4cb4-b9ab-c4603a3f6732-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:12 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (5aac4a06-f783-4e50-a50c-f33440bf07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359af034-e860-4f36-a0fa-9d83c94d0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359af034-e860-4f36-a0fa-9d83c94d0184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859155171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3cedd-4ff9-413d-bb0e-396454255ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:13Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6647b65e-2459-41d0-a8a1-9de6d6092094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6647b65e-2459-41d0-a8a1-9de6d6092094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139a1b0e-7ffd-406f-8ee4-8c0447af7a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139a1b0e-7ffd-406f-8ee4-8c0447af7a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c3cedd-4ff9-413d-bb0e-396454255ddb', 'volume_name': 'volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbabae0-b344-4a23-ae90-7851d00a8883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbabae0-b344-4a23-ae90-7851d00a8883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7b8f5f-8140-4180-95ce-63017a613c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:13 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Volume c2c3cedd-4ff9-413d-bb0e-396454255ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb', 'volume_size': 1} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859155171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3cedd-4ff9-413d-bb0e-396454255ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:13Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Creating volume c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:13 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:13 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb 1073741824 Sep 23 00:35:13 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:13 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb 1073741824" returned: 0 in 0.647s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:13 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb Sep 23 00:35:13 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:14 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb" returned: 0 in 0.337s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7b8f5f-8140-4180-95ce-63017a613c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60629640-9b27-4a63-a8ab-76d704c2b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:14 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Volume volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb (c2c3cedd-4ff9-413d-bb0e-396454255ddb): created successfully Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60629640-9b27-4a63-a8ab-76d704c2b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:14 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (5aac4a06-f783-4e50-a50c-f33440bf07b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-304c5fbb-f285-4341-865c-bb67a4702f41 tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:35:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Creating offline snapshot 72483420-631c-49da-a37f-3b99452a7d31 of volume c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71ab4c-15f5-44df-a2c5-36a1dae8081e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:15 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb Sep 23 00:35:15 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:16 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb" returned: 0 in 0.562s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:16 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 1G Sep 23 00:35:16 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:16 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 1G" returned: 0 in 0.512s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:16 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 Sep 23 00:35:16 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:16 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:16 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 is being set with open permissions: ugo+rw Sep 23 00:35:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:16 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 Sep 23 00:35:16 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:17 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Flow 'volume_create_manager' (c375c725-0c7b-4e1a-b27d-8504ea46e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7577d86-0bf2-4078-8b12-84b461e0a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31" returned: 0 in 0.301s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7577d86-0bf2-4078-8b12-84b461e0a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1156343394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f58a5fd-bd0c-41e2-b572-f8d168d3511c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd77aa914448a7a212ceb4fff70b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='c62fbe4669cb4cb88b2aa989fcdba008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af320e8d-648d-4748-961a-070a2d155305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af320e8d-648d-4748-961a-070a2d155305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae06cf5-01d7-4e55-a496-61c265c4359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae06cf5-01d7-4e55-a496-61c265c4359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f58a5fd-bd0c-41e2-b572-f8d168d3511c', 'volume_name': 'volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c7d4f2-0817-4ee4-8417-a697decf6b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c7d4f2-0817-4ee4-8417-a697decf6b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b5f2e4-217a-45ef-8721-8346ea0e110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:17 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Volume 1f58a5fd-bd0c-41e2-b572-f8d168d3511c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c', 'volume_size': 1} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info Sep 23 00:35:17 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info is being set with open permissions: ugo+rw Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info Sep 23 00:35:17 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.info" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1156343394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f58a5fd-bd0c-41e2-b572-f8d168d3511c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd77aa914448a7a212ceb4fff70b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:17Z,use_quota=True,user_id='c62fbe4669cb4cb88b2aa989fcdba008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Creating volume 1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:17 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c 1073741824 Sep 23 00:35:17 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-32601169-6dc1-45ef-968f-ac7302ede3b8 tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:35:18 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c 1073741824" returned: 0 in 0.452s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:18 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:18 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-72483420-631c-49da-a37f-3b99452a7d31-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-72483420-631c-49da-a37f-3b99452a7d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:18 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-72483420-631c-49da-a37f-3b99452a7d31" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b5f2e4-217a-45ef-8721-8346ea0e110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3371653a-8cd9-4035-aae6-cccc3c277eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-72483420-631c-49da-a37f-3b99452a7d31" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot 72483420-631c-49da-a37f-3b99452a7d31 of volume c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:18 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Volume volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c (1f58a5fd-bd0c-41e2-b572-f8d168d3511c): created successfully Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3371653a-8cd9-4035-aae6-cccc3c277eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Flow 'volume_create_manager' (c375c725-0c7b-4e1a-b27d-8504ea46e7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac5f0b-002e-4287-8cc7-05e342e2574d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:18 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e5b13260-75ae-46b7-a01c-61143c198a19 tempest-SnapshotDependencyTests-332076060 None] Created volume successfully. Sep 23 00:35:18 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 Sep 23 00:35:18 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31" returned: 0 in 0.409s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a6ca4-a56d-48d0-ab1e-8d7915cefd56]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb Sep 23 00:35:19 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Creating offline snapshot 81f24711-27c5-4df2-ba92-344ff4ce403a of volume 1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a02c21-d512-40b1-91e8-a627bf89010a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 Sep 23 00:35:19 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:19 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:19 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31" returned: 0 in 0.370s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:19 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31 Sep 23 00:35:19 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a 1G Sep 23 00:35:20 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb.72483420-631c-49da-a37f-3b99452a7d31" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-72483420-631c-49da-a37f-3b99452a7d31" released by "_delete_snapshot" :: held 1.612s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" released by "delete_snapshot" :: held 1.656s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Created reservations ['77ffa071-b6c0-4ade-b81b-406ca3c40fca', '00fc6dcd-c23b-4fed-8782-ca948750acd4', '9b201591-a92b-4413-aa3d-d2f372a23673', '6d3f6c33-a492-4c4c-971a-d123a13565aa'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:20 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-4f4c754c-7c21-4f7a-919c-c5223fb76979 tempest-ProjectMemberTests-667315727 None] Lock "cinder-72483420-631c-49da-a37f-3b99452a7d31-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:20 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a 1G" returned: 0 in 0.470s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:20 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:20 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-c2c3cedd-4ff9-413d-bb0e-396454255ddb-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:20 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.319s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:20 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a is being set with open permissions: ugo+rw Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-c2c3cedd-4ff9-413d-bb0e-396454255ddb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:20 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:20 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e3692-ff76-46dd-b945-095375aa96f7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:20 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb Sep 23 00:35:21 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.287s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info Sep 23 00:35:21 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb Sep 23 00:35:21 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info is being set with open permissions: ugo+rw Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info Sep 23 00:35:21 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c2c3cedd-4ff9-413d-bb0e-396454255ddb" returned: 0 in 0.269s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c2c3cedd-4ff9-413d-bb0e-396454255ddb" released by "delete_volume" :: held 0.739s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:21 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.info" returned: 0 in 0.249s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:21 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3324e65e-2798-4dda-b2ea-9aec4061f9e3 tempest-SnapshotDependencyTests-332076060 None] Create snapshot completed successfully Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Created reservations ['56de176c-8e78-4ebb-859e-7db6d8666195', 'c81ea422-8cd1-4daf-a7f8-2d7543670e52', '394ca301-618d-4d45-bbbf-597c983d1d0f', '778778ad-eedf-4603-acd1-9b9ec1a542cd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:21 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:21 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:22 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.271s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:22 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=128,cinder:UPDATE=176,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-71a40b04-68b4-40de-860e-31464a1274f6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-c2c3cedd-4ff9-413d-bb0e-396454255ddb-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=135,cinder:INSERT=46,cinder:UPDATE=174,cinder:DELETE=14 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d59d1ef7-89d8-4b38-9a09-82cda6a5fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05363963-12ed-4078-990c-955206bad79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05363963-12ed-4078-990c-955206bad79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925236355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78968a8-2857-4f3f-a494-0a0a3f8f0386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:22Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee76692-a875-47c1-8e7b-1efbab529162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee76692-a875-47c1-8e7b-1efbab529162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668da78f-a781-4ef0-aaff-e89cddccc218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668da78f-a781-4ef0-aaff-e89cddccc218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78968a8-2857-4f3f-a494-0a0a3f8f0386', 'volume_name': 'volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021c0d40-74a1-47a9-b2a8-449a9a174100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021c0d40-74a1-47a9-b2a8-449a9a174100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e131d6-19e5-4bbc-bfc8-fa14575c2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:22 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Volume f78968a8-2857-4f3f-a494-0a0a3f8f0386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386', 'volume_size': 1} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925236355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78968a8-2857-4f3f-a494-0a0a3f8f0386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:22Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Creating volume f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:22 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:22 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:22 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 1073741824 Sep 23 00:35:22 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:23 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 1073741824" returned: 0 in 0.505s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:23 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 Sep 23 00:35:23 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:23 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386" returned: 0 in 0.364s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Flow 'volume_create_manager' (8cc635a1-065a-4ba3-8a33-508e5cf4871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5999d-1b51-4d85-8e86-e2fee4dd28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5999d-1b51-4d85-8e86-e2fee4dd28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c736be13-67d4-48c9-b6b1-3cb1b08902dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fd77aa914448a7a212ceb4fff70b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81f24711-27c5-4df2-ba92-344ff4ce403a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:23Z,use_quota=True,user_id='c62fbe4669cb4cb88b2aa989fcdba008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f476c40a-fa20-4da2-bd2c-f4a2eceebeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f476c40a-fa20-4da2-bd2c-f4a2eceebeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5830c200-03ea-4f02-9dc1-3813a528a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5830c200-03ea-4f02-9dc1-3813a528a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c736be13-67d4-48c9-b6b1-3cb1b08902dc', 'volume_name': 'volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc', 'volume_size': 1, 'snapshot_id': '81f24711-27c5-4df2-ba92-344ff4ce403a'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b281179-83a0-4ab6-8972-3dfe11c92b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b281179-83a0-4ab6-8972-3dfe11c92b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8933c66f-9a87-4e66-8aa5-65b8d3ee5e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Volume c736be13-67d4-48c9-b6b1-3cb1b08902dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc', 'volume_size': 1, 'snapshot_id': '81f24711-27c5-4df2-ba92-344ff4ce403a'} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e131d6-19e5-4bbc-bfc8-fa14575c2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a8d4eb-8908-4f12-b08f-e0105736e793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a-c736be13-67d4-48c9-b6b1-3cb1b08902dc" by "_create_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Volume volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 (f78968a8-2857-4f3f-a494-0a0a3f8f0386): created successfully Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a8d4eb-8908-4f12-b08f-e0105736e793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d59d1ef7-89d8-4b38-9a09-82cda6a5fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a-c736be13-67d4-48c9-b6b1-3cb1b08902dc" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Creating volume c736be13-67d4-48c9-b6b1-3cb1b08902dc from snapshot 81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" by "_copy_volume_from_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] snapshot: 81f24711-27c5-4df2-ba92-344ff4ce403a, volume: c736be13-67d4-48c9-b6b1-3cb1b08902dc, {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:35:23 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d6c8d58e-e6ba-4adf-938b-573e658c4a4e tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d360b91-0e1e-481c-a0ba-6c02c0998f2d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:23 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:23 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:24 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e473c2b-7595-4842-be5f-9864618c5960]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:24 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:24 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:24 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.400s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Creating direct copy from snapshot {{(pid=87132) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG cinder.utils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Path /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc not found in is_blk_device check {{(pid=87132) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:24 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc Sep 23 00:35:24 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:30 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc" returned: 0 in 6.230s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:30 devstack cinder-volume[87132]: DEBUG cinder.image.image_utils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc {{(pid=87132) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:30 devstack cinder-volume[87132]: INFO cinder.image.image_utils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Converted 1024.00 MB image at 164.34 MB/s Sep 23 00:35:30 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc is being set with open permissions: ugo+rw Sep 23 00:35:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:30 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc Sep 23 00:35:30 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc" returned: 0 in 0.248s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" released by "_copy_volume_from_snapshot" :: held 7.363s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a-c736be13-67d4-48c9-b6b1-3cb1b08902dc" released by "_create_volume_from_snapshot" :: held 7.430s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.458s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.294s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Creating offline snapshot 59744473-10e0-4004-893c-0f060d7e332f of volume f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8933c66f-9a87-4e66-8aa5-65b8d3ee5e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc', 'volume_size': 1, 'snapshot_id': '81f24711-27c5-4df2-ba92-344ff4ce403a'}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3fd7c-2f7b-4f0b-a8e9-ce46bbf1d9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aab535-8f59-4515-8237-9ed266b7d265]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Volume volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc (c736be13-67d4-48c9-b6b1-3cb1b08902dc): created successfully Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3fd7c-2f7b-4f0b-a8e9-ce46bbf1d9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Flow 'volume_create_manager' (8cc635a1-065a-4ba3-8a33-508e5cf4871d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5a662c1a-0e2c-4b80-b69a-1c1d0ee03773 tempest-SnapshotDependencyTests-332076060 None] Created volume successfully. Sep 23 00:35:31 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 Sep 23 00:35:31 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f 1G Sep 23 00:35:31 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f 1G" returned: 0 in 0.429s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f Sep 23 00:35:31 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-81f24711-27c5-4df2-ba92-344ff4ce403a-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-81f24711-27c5-4df2-ba92-344ff4ce403a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Deleting offline snapshot 81f24711-27c5-4df2-ba92-344ff4ce403a of volume 1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] snapshot_file for this snap is: volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66aa5f9-28c9-4b42-8812-421f406f4f9c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f is being set with open permissions: ugo+rw Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f Sep 23 00:35:32 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:32 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info Sep 23 00:35:32 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462e30f-1635-4a48-9758-2c1f6e7ecfa6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:32 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info" returned: 0 in 0.282s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info is being set with open permissions: ugo+rw Sep 23 00:35:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info Sep 23 00:35:32 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.info" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3d208173-500e-48cc-923f-fdab3af3723f tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:35:33 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.584s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:33 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.340s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a Sep 23 00:35:33 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c.81f24711-27c5-4df2-ba92-344ff4ce403a" returned: 0 in 0.253s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-81f24711-27c5-4df2-ba92-344ff4ce403a" released by "_delete_snapshot" :: held 1.686s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" released by "delete_snapshot" :: held 1.711s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Created reservations ['50c0b51b-6375-4cf5-9887-e61747a25fc1', '2d52228e-8f13-4f45-9e86-1db32ba81338', '56b0f8e2-6280-48ae-9d44-148cd3a5dd23', '473a65c3-c62e-421e-95d6-d9a45aa99536'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Delete snapshot completed successfully. Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-ab335b9e-2d72-4e29-9050-28597fc1f894 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-81f24711-27c5-4df2-ba92-344ff4ce403a-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-59744473-10e0-4004-893c-0f060d7e332f-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-59744473-10e0-4004-893c-0f060d7e332f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-59744473-10e0-4004-893c-0f060d7e332f" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-1f58a5fd-bd0c-41e2-b572-f8d168d3511c-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-59744473-10e0-4004-893c-0f060d7e332f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot 59744473-10e0-4004-893c-0f060d7e332f of volume f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-1f58a5fd-bd0c-41e2-b572-f8d168d3511c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d43959-e2e5-41a5-9c2f-b889b509c43f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[29305ba7-fcfd-4886-90b6-9f3ef1ee4a13]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:34 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f Sep 23 00:35:34 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:34 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:34 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:34 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f" returned: 0 in 0.461s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7628b8dd-34dd-4562-bcdf-014fdc5e3624]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 Sep 23 00:35:35 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.524s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c Sep 23 00:35:35 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f Sep 23 00:35:35 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-1f58a5fd-bd0c-41e2-b572-f8d168d3511c" released by "delete_volume" :: held 0.898s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Created reservations ['47c9967a-91ef-44df-837a-52b698d8bd31', '787241f2-a141-40ec-b939-8cb7c216caca', '94a3c66f-bc7e-4d73-9ec9-e37f2a78c4cd', '54ead203-947b-40f2-baf0-6ff4292e222f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:35 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f" returned: 0 in 0.383s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f Sep 23 00:35:35 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.291s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:35 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Deleted volume successfully. Sep 23 00:35:35 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9f88e09d-2884-4d21-b6a5-4574519958a1 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-1f58a5fd-bd0c-41e2-b572-f8d168d3511c-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:36 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386.59744473-10e0-4004-893c-0f060d7e332f" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-59744473-10e0-4004-893c-0f060d7e332f" released by "_delete_snapshot" :: held 1.654s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" released by "delete_snapshot" :: held 1.695s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Created reservations ['26caade3-144e-48d2-a2a6-691bb519b837', '2c74a69b-428a-4bf8-99cc-f715b98495a3', '73d4ec6b-7939-40d5-9f19-7cb119154f8e', 'd5b7c76b-e9dd-4457-bcce-6deb6b6dc260'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:36 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c5b640c-d939-4903-b785-47f847ce5574 tempest-ProjectMemberTests-667315727 None] Lock "cinder-59744473-10e0-4004-893c-0f060d7e332f-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-f78968a8-2857-4f3f-a494-0a0a3f8f0386-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-f78968a8-2857-4f3f-a494-0a0a3f8f0386-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" acquired by "delete_volume" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16eec4c-a7df-46d7-9aa9-6bb35b6b73e3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-c736be13-67d4-48c9-b6b1-3cb1b08902dc-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-c736be13-67d4-48c9-b6b1-3cb1b08902dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:36 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 Sep 23 00:35:36 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f55e1c-e9ad-49f4-8454-929a306e7e1d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:36 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc Sep 23 00:35:36 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386" returned: 0 in 0.418s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386 Sep 23 00:35:37 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc Sep 23 00:35:37 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-f78968a8-2857-4f3f-a494-0a0a3f8f0386" returned: 0 in 0.292s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f78968a8-2857-4f3f-a494-0a0a3f8f0386" released by "delete_volume" :: held 0.778s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Created reservations ['b79dc580-17be-4c3b-8fd3-01ef8c00aa81', 'b1feefbb-fe33-4b8d-b1b6-253f4d651723', '211a5b3b-c535-40b4-918d-fd6edadf5a17', 'e8ad7587-dc3a-483c-8b35-5d90e1cf0adf'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:37 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c736be13-67d4-48c9-b6b1-3cb1b08902dc" returned: 0 in 0.293s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-quobyte-c736be13-67d4-48c9-b6b1-3cb1b08902dc" released by "delete_volume" :: held 0.754s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:37 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Created reservations ['cf9f20ca-4d2e-4aaa-a00b-146bf77e1cea', '3eba4483-8663-4917-b632-4df21c01b18d', '24f00756-b8e8-4738-b9ac-858ec814475c', 'f58a4849-f9be-4ec2-99ec-0ce97ff85f16'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:37 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-095e7771-b529-415d-ac45-2250fddb02e6 tempest-ProjectMemberTests-667315727 None] Lock "cinder-f78968a8-2857-4f3f-a494-0a0a3f8f0386-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:38 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.345s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:38 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Deleted volume successfully. Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8aa7ef27-22a4-4114-8906-535cdce9eed7 tempest-SnapshotDependencyTests-332076060 None] Lock "cinder-c736be13-67d4-48c9-b6b1-3cb1b08902dc-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (03d87353-d3ed-4cd4-af97-2faf0b7d1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec50c5c-a8cd-4ca1-8e85-87c0ed0f00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec50c5c-a8cd-4ca1-8e85-87c0ed0f00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109311571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e56934-3c20-41fa-96a7-983a54a6c5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:38Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c5d749-4b22-4b95-9f1d-da31cc86d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c5d749-4b22-4b95-9f1d-da31cc86d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37cba2-cb94-4a8e-8f28-ea36b174ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e37cba2-cb94-4a8e-8f28-ea36b174ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e56934-3c20-41fa-96a7-983a54a6c5e0', 'volume_name': 'volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6efa34-699c-40e5-b018-e08a78691d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6efa34-699c-40e5-b018-e08a78691d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dacd184-af04-4302-b257-7018e38fe402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:38 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Volume e6e56934-3c20-41fa-96a7-983a54a6c5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0', 'volume_size': 1} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109311571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e56934-3c20-41fa-96a7-983a54a6c5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:38Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Creating volume e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:38 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:38 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 1073741824 Sep 23 00:35:38 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:38 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:38 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 1073741824" returned: 0 in 0.517s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:39 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 Sep 23 00:35:39 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:39 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0" returned: 0 in 0.322s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dacd184-af04-4302-b257-7018e38fe402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6015cc-1564-4148-950b-0409b55f6605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:39 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Volume volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 (e6e56934-3c20-41fa-96a7-983a54a6c5e0): created successfully Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6015cc-1564-4148-950b-0409b55f6605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:39 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (03d87353-d3ed-4cd4-af97-2faf0b7d1cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:39 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-89dc29ad-d863-47b4-be61-e905be3f5f39 tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:35:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:40 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Creating offline snapshot f0cbd259-1b4e-4749-bdd1-2cdb094d1544 of volume e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:40 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed928fad-7827-4f01-a87e-c26a0195d68b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:40 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 Sep 23 00:35:40 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0" returned: 0 in 0.435s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:41 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 1G Sep 23 00:35:41 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 1G" returned: 0 in 0.441s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:41 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 Sep 23 00:35:41 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544" returned: 0 in 0.347s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 is being set with open permissions: ugo+rw Sep 23 00:35:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:41 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 Sep 23 00:35:41 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:42 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:42 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info Sep 23 00:35:42 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:42 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info" returned: 0 in 0.324s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:42 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info is being set with open permissions: ugo+rw Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:42 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info Sep 23 00:35:42 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:42 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.info" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-85125d21-421b-442a-91aa-b9dedcfec8a0 tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-f0cbd259-1b4e-4749-bdd1-2cdb094d1544-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-f0cbd259-1b4e-4749-bdd1-2cdb094d1544-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-f0cbd259-1b4e-4749-bdd1-2cdb094d1544" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f0cbd259-1b4e-4749-bdd1-2cdb094d1544" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot f0cbd259-1b4e-4749-bdd1-2cdb094d1544 of volume e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb06e61-9378-4795-928a-37b2cc262b3b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:43 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 Sep 23 00:35:43 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce2702-019a-4166-a2df-187201a230c7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:44 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 Sep 23 00:35:44 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0" returned: 0 in 0.417s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:44 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 Sep 23 00:35:44 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544" returned: 0 in 0.427s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544 Sep 23 00:35:45 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0.f0cbd259-1b4e-4749-bdd1-2cdb094d1544" returned: 0 in 0.315s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f0cbd259-1b4e-4749-bdd1-2cdb094d1544" released by "_delete_snapshot" :: held 1.732s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" released by "delete_snapshot" :: held 1.759s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Created reservations ['6c670088-3c28-445b-923d-16cf0fa89a51', '9d07e811-c1d3-4ee0-8b4a-caab4639b388', '12bb998d-a64c-4ff3-93fd-eaf98facb06d', '2deaec7c-2a3f-46a7-a2c5-be12a32ffb43'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:45 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-08ca964b-5161-419f-939a-a0a62806ebfc tempest-ProjectMemberTests-667315727 None] Lock "cinder-f0cbd259-1b4e-4749-bdd1-2cdb094d1544-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-e6e56934-3c20-41fa-96a7-983a54a6c5e0-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:45 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "cinder-e6e56934-3c20-41fa-96a7-983a54a6c5e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8401a1-4714-46a5-8e0f-4d433b5af22f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 Sep 23 00:35:46 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0" returned: 0 in 0.502s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0 Sep 23 00:35:46 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-e6e56934-3c20-41fa-96a7-983a54a6c5e0" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-e6e56934-3c20-41fa-96a7-983a54a6c5e0" released by "delete_volume" :: held 0.890s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:46 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Created reservations ['e59fb79a-943e-4c25-8bb7-54d232bfccfc', 'ad77e485-f4cf-40bf-8be2-00a3da867b49', '76e45fec-849f-480a-8af0-45fdeeed6766', '8eed9e29-1642-43d0-b2e2-0646845be89b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:47 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:47 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:47 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09803f0f-da73-456e-8561-072bed73b08b tempest-ProjectMemberTests-667315727 None] Lock "cinder-e6e56934-3c20-41fa-96a7-983a54a6c5e0-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d1761e80-83dc-4c07-a744-5b5c0ea99a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5027b8cf-4064-44b8-bd1f-5a798f950c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5027b8cf-4064-44b8-bd1f-5a798f950c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283429009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80495938-3682-4bdd-8eef-79abe6e20d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:48Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da5b8f4-aead-4d4d-94c9-b31de427b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da5b8f4-aead-4d4d-94c9-b31de427b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c739bda-7c34-4c40-9ef4-bf8970de332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c739bda-7c34-4c40-9ef4-bf8970de332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80495938-3682-4bdd-8eef-79abe6e20d62', 'volume_name': 'volume-80495938-3682-4bdd-8eef-79abe6e20d62', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c503146d-329d-4984-8081-6b106373c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c503146d-329d-4984-8081-6b106373c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f36327-3373-43be-9ef4-c0022a8141a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:47 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Volume 80495938-3682-4bdd-8eef-79abe6e20d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80495938-3682-4bdd-8eef-79abe6e20d62', 'volume_size': 1} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283429009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80495938-3682-4bdd-8eef-79abe6e20d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:48Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Creating volume 80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:47 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:35:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:47 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 1073741824 Sep 23 00:35:47 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:48 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 1073741824" returned: 0 in 0.551s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:48 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 Sep 23 00:35:48 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:48 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62" returned: 0 in 0.333s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f36327-3373-43be-9ef4-c0022a8141a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80495938-3682-4bdd-8eef-79abe6e20d62', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53f8511-164d-449d-9195-9499f8c9afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:48 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Volume volume-80495938-3682-4bdd-8eef-79abe6e20d62 (80495938-3682-4bdd-8eef-79abe6e20d62): created successfully Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53f8511-164d-449d-9195-9499f8c9afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:48 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d1761e80-83dc-4c07-a744-5b5c0ea99a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:48 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-27e48210-0367-4940-af51-23b25ba801b1 tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:49 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:35:49 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Creating offline snapshot f16d4a03-5eb5-423d-b05a-8cfd783af63f of volume 80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2320379-1687-43bc-aa5a-959786acc0c3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:50 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.449s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:35:50 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 Sep 23 00:35:50 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:50 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:50 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f 1G Sep 23 00:35:50 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:51 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f 1G" returned: 0 in 0.535s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80495938-3682-4bdd-8eef-79abe6e20d62 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:51 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80495938-3682-4bdd-8eef-79abe6e20d62 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f Sep 23 00:35:51 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:51 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80495938-3682-4bdd-8eef-79abe6e20d62 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f" returned: 0 in 0.393s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:51 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f is being set with open permissions: ugo+rw Sep 23 00:35:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:51 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f Sep 23 00:35:51 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:52 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:52 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info Sep 23 00:35:52 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:52 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:52 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info is being set with open permissions: ugo+rw Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:52 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info Sep 23 00:35:52 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:52 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.info" returned: 0 in 0.262s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:52 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d1cb24e9-3e65-4449-92ec-04174fa8d3a3 tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-f16d4a03-5eb5-423d-b05a-8cfd783af63f-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-f16d4a03-5eb5-423d-b05a-8cfd783af63f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-f16d4a03-5eb5-423d-b05a-8cfd783af63f" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f16d4a03-5eb5-423d-b05a-8cfd783af63f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot f16d4a03-5eb5-423d-b05a-8cfd783af63f of volume 80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f3be11-9954-4e85-87df-f2c0e6cb8f7d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:53 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f Sep 23 00:35:53 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:53 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80495938-3682-4bdd-8eef-79abe6e20d62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85ed3e-76a2-41e9-a245-4388eef4f5ef]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:54 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 Sep 23 00:35:54 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:54 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62" returned: 0 in 0.360s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:54 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f Sep 23 00:35:54 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:54 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:54 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f Sep 23 00:35:54 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:54 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62.f16d4a03-5eb5-423d-b05a-8cfd783af63f" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:54 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-f16d4a03-5eb5-423d-b05a-8cfd783af63f" released by "_delete_snapshot" :: held 1.460s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" released by "delete_snapshot" :: held 1.485s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:55 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Created reservations ['0b921a37-eee1-45b5-b0c8-ecc91eb6bceb', '3a6c44eb-44bd-486d-a71e-3611a4c25d5e', '2d0f1c85-0933-47b9-99ca-da673192b6ea', 'becd57f5-5d57-4b93-be38-c4ea95453e60'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:55 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:35:55 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-042f897d-dbda-4243-a308-519b1ffe2829 tempest-ProjectMemberTests-667315727 None] Lock "cinder-f16d4a03-5eb5-423d-b05a-8cfd783af63f-delete_snapshot" released by "delete_snapshot" :: held 2.425s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-80495938-3682-4bdd-8eef-79abe6e20d62-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "cinder-80495938-3682-4bdd-8eef-79abe6e20d62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d052e-1572-4814-bb17-32d7a20a7f70]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:57 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 Sep 23 00:35:57 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:58 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62" returned: 0 in 0.396s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:58 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62 Sep 23 00:35:58 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:58 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-80495938-3682-4bdd-8eef-79abe6e20d62" returned: 0 in 0.254s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:58 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-80495938-3682-4bdd-8eef-79abe6e20d62" released by "delete_volume" :: held 0.714s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Created reservations ['4b4187b4-32b4-4cef-b1b9-b9e7f1d38543', '3c23ee37-50da-4917-b554-a3983f6b61a8', 'e186c546-6854-4b76-a528-e781b88ae846', '2ca6ab2d-ede3-4bb6-99da-45974a34dcdd'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:00 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:00 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:00 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.266s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:00 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-86a9b961-5207-4fb8-a121-5e9fe89426ab tempest-ProjectMemberTests-667315727 None] Lock "cinder-80495938-3682-4bdd-8eef-79abe6e20d62-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (68439297-5fae-48a3-be02-595eb796cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36367774-6b01-483f-88b8-e81ffef6f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36367774-6b01-483f-88b8-e81ffef6f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076576394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c058c8-8950-4861-b1fa-b9a10ecb88c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6197d65c-adf5-4955-94bb-ae716c005108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6197d65c-adf5-4955-94bb-ae716c005108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4a73b7-fedf-477e-a980-aed0b758535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4a73b7-fedf-477e-a980-aed0b758535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c058c8-8950-4861-b1fa-b9a10ecb88c6', 'volume_name': 'volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f76615-9009-4f07-a796-7af584264277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f76615-9009-4f07-a796-7af584264277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39da514b-bd80-4e2e-99a5-a228b93d51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Volume 03c058c8-8950-4861-b1fa-b9a10ecb88c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6', 'volume_size': 1} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076576394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c058c8-8950-4861-b1fa-b9a10ecb88c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Creating volume 03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:00 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:00 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 1073741824 Sep 23 00:36:00 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:01 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 1073741824" returned: 0 in 0.457s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:01 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 Sep 23 00:36:01 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:01 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39da514b-bd80-4e2e-99a5-a228b93d51f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01419f0f-356b-4b04-b057-4abb83373d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Volume volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 (03c058c8-8950-4861-b1fa-b9a10ecb88c6): created successfully Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01419f0f-356b-4b04-b057-4abb83373d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (68439297-5fae-48a3-be02-595eb796cb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-a78873cf-6837-4f7f-a6d8-be4a402f7b7b tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Creating offline snapshot a7da7dee-51eb-490e-be18-ee6e6dc1e06c of volume 03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[c126936b-87b1-4677-8909-31857acf37b4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 Sep 23 00:36:03 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6" returned: 0 in 0.386s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c 1G Sep 23 00:36:03 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c 1G" returned: 0 in 0.447s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c Sep 23 00:36:03 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c" returned: 0 in 0.326s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c is being set with open permissions: ugo+rw Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c Sep 23 00:36:04 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c" returned: 0 in 0.259s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info Sep 23 00:36:04 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info is being set with open permissions: ugo+rw Sep 23 00:36:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info Sep 23 00:36:04 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.info" returned: 0 in 0.290s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-aa3121a2-7365-43d9-a735-3f62747c0b2d tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-a7da7dee-51eb-490e-be18-ee6e6dc1e06c-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-a7da7dee-51eb-490e-be18-ee6e6dc1e06c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-a7da7dee-51eb-490e-be18-ee6e6dc1e06c" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-a7da7dee-51eb-490e-be18-ee6e6dc1e06c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot a7da7dee-51eb-490e-be18-ee6e6dc1e06c of volume 03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1754a6e-e029-4ff3-ba67-3de7186bfb66]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:06 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c Sep 23 00:36:06 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:06 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c" returned: 0 in 0.444s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1ee11-de00-40af-925a-ead820468729]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:07 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 Sep 23 00:36:07 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:07 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6" returned: 0 in 0.412s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:07 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c Sep 23 00:36:07 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:07 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c" returned: 0 in 0.381s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:07 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c Sep 23 00:36:07 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:07 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6.a7da7dee-51eb-490e-be18-ee6e6dc1e06c" returned: 0 in 0.295s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-a7da7dee-51eb-490e-be18-ee6e6dc1e06c" released by "_delete_snapshot" :: held 1.655s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" released by "delete_snapshot" :: held 1.684s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Created reservations ['82ff3318-46e4-4a68-a091-9119917ed857', 'a57f4d5b-83c5-4d6f-9ded-24be64fd8001', '7ae124e1-f6a4-4ea3-b056-31b57106aa6c', '269d8a0d-e1a4-4b1f-8ec6-933d6739a592'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:08 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-3f68d829-3ee4-46cf-ab4d-18a5c8e89602 tempest-ProjectMemberTests-667315727 None] Lock "cinder-a7da7dee-51eb-490e-be18-ee6e6dc1e06c-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-03c058c8-8950-4861-b1fa-b9a10ecb88c6-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "cinder-03c058c8-8950-4861-b1fa-b9a10ecb88c6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feaf9cc-1659-440d-9a6d-c5e7ab84ea25]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 Sep 23 00:36:08 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6" returned: 0 in 0.390s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6 Sep 23 00:36:09 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-03c058c8-8950-4861-b1fa-b9a10ecb88c6" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-03c058c8-8950-4861-b1fa-b9a10ecb88c6" released by "delete_volume" :: held 0.725s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Created reservations ['c2101742-1b86-4be6-a72d-3674229aec2b', 'f27a49f4-28e0-4893-bd90-6f3a81e67284', 'c9d26240-5074-4e1b-b6c5-c5c35956d5cb', '83b5a12f-88cb-41c4-9d0a-c064c8c5f1ad'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:09 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.342s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:36:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-bc55e3e0-f527-4243-ba22-78f7c3e0d22b tempest-ProjectMemberTests-667315727 None] Lock "cinder-03c058c8-8950-4861-b1fa-b9a10ecb88c6-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d4b8c39b-45ff-454f-a71b-829bc2ac624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d4ffc-e626-4c09-abf3-69a1dbb5269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d4ffc-e626-4c09-abf3-69a1dbb5269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555794878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adebf0b-dd24-4b61-91c5-9dff43fd3cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:10Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15dc115-cb12-4c9a-afd0-7016e5f553c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15dc115-cb12-4c9a-afd0-7016e5f553c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e319fb-4022-4c46-9246-74628d481efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e319fb-4022-4c46-9246-74628d481efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adebf0b-dd24-4b61-91c5-9dff43fd3cd9', 'volume_name': 'volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f398835-9801-4e14-99fc-955ea2403471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f398835-9801-4e14-99fc-955ea2403471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d04d95-5a49-4f7b-a2d5-cd461139ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:10 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Volume 0adebf0b-dd24-4b61-91c5-9dff43fd3cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9', 'volume_size': 1} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555794878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adebf0b-dd24-4b61-91c5-9dff43fd3cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18369369c82a45849eefd8ea2c764d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:10Z,use_quota=True,user_id='fd306528eadb4c6091ac8137351f8d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Creating volume 0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:10 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 1073741824 Sep 23 00:36:10 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 1073741824" returned: 0 in 0.463s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 Sep 23 00:36:10 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:11 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" returned: 0 in 0.299s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d04d95-5a49-4f7b-a2d5-cd461139ceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65fc8e5-f7ce-40f2-90fb-082be83315a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:11 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Volume volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 (0adebf0b-dd24-4b61-91c5-9dff43fd3cd9): created successfully Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65fc8e5-f7ce-40f2-90fb-082be83315a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:11 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Flow 'volume_create_manager' (d4b8c39b-45ff-454f-a71b-829bc2ac624f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:11 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-39549bc6-9fb4-4730-9a10-73fc918e9921 tempest-ProjectMemberTests-667315727 None] Created volume successfully. Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Creating offline snapshot c6474b60-0d2e-44a9-a70d-9adf6c0ca158 of volume 0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d13428-2e36-4bc3-b5e6-99deee6034c0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 Sep 23 00:36:12 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:12 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" returned: 0 in 0.379s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:12 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:12 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 1G Sep 23 00:36:12 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 1G" returned: 0 in 0.455s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 Sep 23 00:36:13 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 is being set with open permissions: ugo+rw Sep 23 00:36:13 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 Sep 23 00:36:13 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:14 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info Sep 23 00:36:14 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info" returned: 0 in 0.277s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info is being set with open permissions: ugo+rw Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:14 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info Sep 23 00:36:14 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.info" returned: 0 in 0.281s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:14 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-4971707c-8255-4c59-9b0d-8728f8c26bc0 tempest-ProjectMemberTests-667315727 None] Create snapshot completed successfully Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-c6474b60-0d2e-44a9-a70d-9adf6c0ca158-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-c6474b60-0d2e-44a9-a70d-9adf6c0ca158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-c6474b60-0d2e-44a9-a70d-9adf6c0ca158" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c6474b60-0d2e-44a9-a70d-9adf6c0ca158" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Deleting offline snapshot c6474b60-0d2e-44a9-a70d-9adf6c0ca158 of volume 0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] snapshot_file for this snap is: volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2b232d-409c-4ced-afe2-bd65816fbf48]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:15 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 Sep 23 00:36:16 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:16 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158" returned: 0 in 0.432s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[15107c52-f598-4ad0-b6ef-38c848dbc568]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 Sep 23 00:36:16 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:16 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:16 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 Sep 23 00:36:16 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158" returned: 0 in 0.391s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158 Sep 23 00:36:17 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9.c6474b60-0d2e-44a9-a70d-9adf6c0ca158" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-c6474b60-0d2e-44a9-a70d-9adf6c0ca158" released by "_delete_snapshot" :: held 1.583s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" released by "delete_snapshot" :: held 1.611s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Created reservations ['ddc93f67-7e52-4b3f-9a09-4107ec66a775', '7986e134-9131-4739-a070-2e88a1f8ded6', 'e46666b9-d63c-4bcd-a26f-65653de3030d', 'e639f582-fa3e-4622-95db-cf46e20c729b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:17 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Delete snapshot completed successfully. Sep 23 00:36:17 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-864b0fc0-1672-4e03-848b-d14a7e7fd52b tempest-ProjectMemberTests-667315727 None] Lock "cinder-c6474b60-0d2e-44a9-a70d-9adf6c0ca158-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "cinder-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Acquiring lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" acquired by "delete_volume" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fcb223-cd1c-4536-8d00-bdf2daf20bf6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 Sep 23 00:36:18 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" returned: 0 in 0.426s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9 Sep 23 00:36:18 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" returned: 0 in 0.302s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "cinder-quobyte-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9" released by "delete_volume" :: held 0.809s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:18 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Created reservations ['36e6b287-7525-4fa1-b66d-421c71c84a2d', '3aded394-3068-4893-84fb-3cc999ed7794', '8a60f400-3138-4435-b0b4-fac9b60341e6', '2b6291ae-17ab-4f0a-b582-58ba15e4cc25'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:19 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.298s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:19 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Deleted volume successfully. Sep 23 00:36:19 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-9c96aedc-5253-4500-874c-b7d7634ceabc tempest-ProjectMemberTests-667315727 None] Lock "cinder-0adebf0b-dd24-4b61-91c5-9dff43fd3cd9-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:UPDATE=121,cinder:SELECT=86,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=93,cinder:UPDATE=110,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (0a81676a-44ed-4bd2-9109-d19d6e088857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a4c84d-a4e9-48ac-b115-0994407d52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a4c84d-a4e9-48ac-b115-0994407d52e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308705629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eb411f-43cd-45b2-b91c-ea87b660c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a0a71-e234-4f38-8407-5d1383d50fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a0a71-e234-4f38-8407-5d1383d50fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6587e82e-733f-4f72-b5fe-446496311ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6587e82e-733f-4f72-b5fe-446496311ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0eb411f-43cd-45b2-b91c-ea87b660c485', 'volume_name': 'volume-c0eb411f-43cd-45b2-b91c-ea87b660c485', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b713c8f-29cd-43ee-b7e2-0cebfa9b1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b713c8f-29cd-43ee-b7e2-0cebfa9b1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8396f6c-7fef-4cd0-8362-10bfa0a0c916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Volume c0eb411f-43cd-45b2-b91c-ea87b660c485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0eb411f-43cd-45b2-b91c-ea87b660c485', 'volume_size': 1} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308705629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eb411f-43cd-45b2-b91c-ea87b660c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Creating volume c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:23 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:23 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 1073741824 Sep 23 00:36:24 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 1073741824" returned: 0 in 0.451s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 Sep 23 00:36:24 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8396f6c-7fef-4cd0-8362-10bfa0a0c916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0eb411f-43cd-45b2-b91c-ea87b660c485', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2fd0f4-fc0b-4e23-839e-0d2995a7c59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Volume volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 (c0eb411f-43cd-45b2-b91c-ea87b660c485): created successfully Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2fd0f4-fc0b-4e23-839e-0d2995a7c59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (0a81676a-44ed-4bd2-9109-d19d6e088857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:24 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ed5fa29b-1d29-4cb2-a2c7-a1f0f4575188 tempest-ProjectReaderTests-495903578 None] Created volume successfully. Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Creating offline snapshot b935a733-aacb-4101-92b7-5729cf92a953 of volume c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b5697-2ea2-460a-a797-b07a4db18f80]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:26 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 Sep 23 00:36:26 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:26 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485" returned: 0 in 0.469s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:26 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:26 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 1G Sep 23 00:36:26 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 1G" returned: 0 in 0.510s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 Sep 23 00:36:27 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953" returned: 0 in 0.359s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 is being set with open permissions: ugo+rw Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 Sep 23 00:36:27 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info Sep 23 00:36:27 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info is being set with open permissions: ugo+rw Sep 23 00:36:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info Sep 23 00:36:28 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.info" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e211956d-20ea-43d1-9f17-02f8a76bf326 tempest-ProjectReaderTests-495903578 None] Create snapshot completed successfully Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-b935a733-aacb-4101-92b7-5729cf92a953-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-b935a733-aacb-4101-92b7-5729cf92a953-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-b935a733-aacb-4101-92b7-5729cf92a953" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-b935a733-aacb-4101-92b7-5729cf92a953" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Deleting offline snapshot b935a733-aacb-4101-92b7-5729cf92a953 of volume c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] snapshot_file for this snap is: volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[03493a61-897e-4fbb-a05b-b5998886b482]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:29 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 Sep 23 00:36:29 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953" returned: 0 in 0.484s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0eb411f-43cd-45b2-b91c-ea87b660c485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6b7a9-43e7-46ee-89af-991de61543ff]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 Sep 23 00:36:30 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485" returned: 0 in 0.450s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 Sep 23 00:36:30 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953" returned: 0 in 0.464s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953 Sep 23 00:36:31 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485.b935a733-aacb-4101-92b7-5729cf92a953" returned: 0 in 0.307s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-b935a733-aacb-4101-92b7-5729cf92a953" released by "_delete_snapshot" :: held 1.828s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" released by "delete_snapshot" :: held 1.863s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Created reservations ['a3892377-aebf-4656-a4ec-83062a5de126', 'bb86be12-e98c-4394-9f34-2eb9740286d9', '5605de7c-f0c8-4685-b5ed-a57f3185463a', 'b02de8c8-27af-456a-8b86-4a55c23370b6'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:31 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Delete snapshot completed successfully. Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-170d0521-4ec4-48ff-a1f2-39efb2a3b365 tempest-ProjectReaderTests-495903578 None] Lock "cinder-b935a733-aacb-4101-92b7-5729cf92a953-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-c0eb411f-43cd-45b2-b91c-ea87b660c485-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "cinder-c0eb411f-43cd-45b2-b91c-ea87b660c485-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" acquired by "delete_volume" :: waited 0.024s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[f990c307-c534-4fcb-8e57-e19050c3ea1d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:31 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 Sep 23 00:36:32 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485" returned: 0 in 0.442s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485 Sep 23 00:36:32 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-c0eb411f-43cd-45b2-b91c-ea87b660c485" returned: 0 in 0.316s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c0eb411f-43cd-45b2-b91c-ea87b660c485" released by "delete_volume" :: held 0.835s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Created reservations ['94c46063-975f-437b-8069-0c39e402a174', '15c32601-0de9-48fb-800d-a0e2eb289851', '04e5c1c7-23fa-48fb-8cb8-aa4a74c8b65e', '68936a45-a390-4a96-b686-2398b8a6fb7a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:32 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:32 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.320s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:33 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Deleted volume successfully. Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8a4aec8f-8141-4168-9bb4-a0833ce6c99f tempest-ProjectReaderTests-495903578 None] Lock "cinder-c0eb411f-43cd-45b2-b91c-ea87b660c485-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (5a0db81e-2fd4-4f80-a149-bdd463d2bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e1f1cf-b6c7-4674-a96d-63d3b74e8e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e1f1cf-b6c7-4674-a96d-63d3b74e8e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039942701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c079d-2bf0-456e-91d1-f0ff2dab7f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:34Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b4fb23-1aad-40db-9e3c-fd09436de166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b4fb23-1aad-40db-9e3c-fd09436de166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7033b02-ee3a-40c4-94d0-a245e316e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7033b02-ee3a-40c4-94d0-a245e316e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3c079d-2bf0-456e-91d1-f0ff2dab7f52', 'volume_name': 'volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98733691-01ef-4719-a192-b2362617d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98733691-01ef-4719-a192-b2362617d970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6786b6-6aee-4630-9410-c9f9f4443d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Volume fd3c079d-2bf0-456e-91d1-f0ff2dab7f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52', 'volume_size': 1} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039942701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c079d-2bf0-456e-91d1-f0ff2dab7f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:34Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Creating volume fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:33 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:33 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 1073741824 Sep 23 00:36:33 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 1073741824" returned: 0 in 0.476s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 Sep 23 00:36:34 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6786b6-6aee-4630-9410-c9f9f4443d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3c1256-7147-41bf-88f8-9c618cb71669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:34 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Volume volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 (fd3c079d-2bf0-456e-91d1-f0ff2dab7f52): created successfully Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3c1256-7147-41bf-88f8-9c618cb71669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (5a0db81e-2fd4-4f80-a149-bdd463d2bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:34 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-239f2ceb-776b-4b62-bf32-8396b4141365 tempest-ProjectReaderTests-495903578 None] Created volume successfully. Sep 23 00:36:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Creating offline snapshot c03c2c5c-c68f-459c-bd02-900ee043a931 of volume fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:35 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[785fa92a-26de-4082-a3a6-6fcf8c436c43]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:35 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 Sep 23 00:36:35 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" returned: 0 in 0.398s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 1G Sep 23 00:36:36 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 1G" returned: 0 in 0.419s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 Sep 23 00:36:36 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931" returned: 0 in 0.349s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 is being set with open permissions: ugo+rw Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 Sep 23 00:36:37 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info Sep 23 00:36:37 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info" returned: 0 in 0.257s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info is being set with open permissions: ugo+rw Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info Sep 23 00:36:37 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.info" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:37 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-86380bca-ee27-4e23-a025-1eb5ec591a72 tempest-ProjectReaderTests-495903578 None] Create snapshot completed successfully Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-c03c2c5c-c68f-459c-bd02-900ee043a931-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-c03c2c5c-c68f-459c-bd02-900ee043a931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-c03c2c5c-c68f-459c-bd02-900ee043a931" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c03c2c5c-c68f-459c-bd02-900ee043a931" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Deleting offline snapshot c03c2c5c-c68f-459c-bd02-900ee043a931 of volume fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] snapshot_file for this snap is: volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23d1e9-95bd-430c-bf58-e9bcedd5dd31]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 Sep 23 00:36:39 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931" returned: 0 in 0.456s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11842c-27b5-4a49-ae20-692702a65d44]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:39 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 Sep 23 00:36:39 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" returned: 0 in 0.415s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 Sep 23 00:36:40 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931" returned: 0 in 0.363s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931 Sep 23 00:36:40 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52.c03c2c5c-c68f-459c-bd02-900ee043a931" returned: 0 in 0.272s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-c03c2c5c-c68f-459c-bd02-900ee043a931" released by "_delete_snapshot" :: held 1.622s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" released by "delete_snapshot" :: held 1.650s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Created reservations ['d295edf0-6683-4d9b-aa12-23dfbcc6c2ab', '6e17e0f3-027e-4eec-9b46-f7adeb782c49', '9902643f-9915-41bb-9605-0316253a3002', 'ada6bdfa-b667-4f44-82c5-30c91c7f066d'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:40 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Delete snapshot completed successfully. Sep 23 00:36:40 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-09b9b97f-b0d3-4c4d-8892-ca650be1769f tempest-ProjectReaderTests-495903578 None] Lock "cinder-c03c2c5c-c68f-459c-bd02-900ee043a931-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "cinder-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" acquired by "delete_volume" :: waited 0.020s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba93773-5486-431d-af6f-11ae3a9f87ff]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 Sep 23 00:36:41 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" returned: 0 in 0.392s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52 Sep 23 00:36:41 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" returned: 0 in 0.273s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52" released by "delete_volume" :: held 0.737s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Created reservations ['aea3b29a-aabb-4e9e-8f5a-eb057f69fb33', '253d6965-5693-436e-9060-7e5ceb42a478', '07e9b8f2-01a2-4212-b369-2ffa8f84ad2d', '313aa229-92c9-456f-87f5-cd5d29a5fb5b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:42 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.256s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:42 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Deleted volume successfully. Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-e8993e36-f711-4398-93b9-7e2b407c21b6 tempest-ProjectReaderTests-495903578 None] Lock "cinder-fd3c079d-2bf0-456e-91d1-f0ff2dab7f52-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (c2851428-e19d-4244-a14f-ad449ed7297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca5eb8-2c9c-4cf3-b443-61536638267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ca5eb8-2c9c-4cf3-b443-61536638267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704573257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4757bcff-2d0f-4633-bf93-ab941df5b068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212a1bdc-f575-4c94-ae63-1d18484ef08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:42 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212a1bdc-f575-4c94-ae63-1d18484ef08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9525b9-c987-4127-86c7-d1483031b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9525b9-c987-4127-86c7-d1483031b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4757bcff-2d0f-4633-bf93-ab941df5b068', 'volume_name': 'volume-4757bcff-2d0f-4633-bf93-ab941df5b068', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32eb7cd-b912-4d98-b53a-3d1977651200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32eb7cd-b912-4d98-b53a-3d1977651200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4e49fe-d62c-459e-af0e-c5d0365eddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Volume 4757bcff-2d0f-4633-bf93-ab941df5b068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4757bcff-2d0f-4633-bf93-ab941df5b068', 'volume_size': 1} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704573257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4757bcff-2d0f-4633-bf93-ab941df5b068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Creating volume 4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:43 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 1073741824 Sep 23 00:36:43 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 1073741824" returned: 0 in 0.479s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 Sep 23 00:36:43 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068" returned: 0 in 0.276s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4e49fe-d62c-459e-af0e-c5d0365eddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4757bcff-2d0f-4633-bf93-ab941df5b068', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9924cd10-8497-4587-9a0b-fb27128b3944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Volume volume-4757bcff-2d0f-4633-bf93-ab941df5b068 (4757bcff-2d0f-4633-bf93-ab941df5b068): created successfully Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9924cd10-8497-4587-9a0b-fb27128b3944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (c2851428-e19d-4244-a14f-ad449ed7297e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:43 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-fb1d1e2a-fe83-4e29-a872-c7c0e0033763 tempest-ProjectReaderTests-495903578 None] Created volume successfully. Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Creating offline snapshot ca3a003a-69f8-468f-82e9-e2967aa3535a of volume 4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbd705-ee76-4720-abb9-93274486b5d7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 Sep 23 00:36:45 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068" returned: 0 in 0.403s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a 1G Sep 23 00:36:45 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a 1G" returned: 0 in 0.458s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4757bcff-2d0f-4633-bf93-ab941df5b068 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4757bcff-2d0f-4633-bf93-ab941df5b068 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a Sep 23 00:36:46 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4757bcff-2d0f-4633-bf93-ab941df5b068 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a" returned: 0 in 0.356s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a is being set with open permissions: ugo+rw Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a Sep 23 00:36:46 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a" returned: 0 in 0.258s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info Sep 23 00:36:46 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info" returned: 0 in 0.251s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info is being set with open permissions: ugo+rw Sep 23 00:36:46 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info Sep 23 00:36:47 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.info" returned: 0 in 0.274s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:47 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-d776c9de-e7d0-462e-bb22-f1fbe39125fd tempest-ProjectReaderTests-495903578 None] Create snapshot completed successfully Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-ca3a003a-69f8-468f-82e9-e2967aa3535a-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-ca3a003a-69f8-468f-82e9-e2967aa3535a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-ca3a003a-69f8-468f-82e9-e2967aa3535a" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-ca3a003a-69f8-468f-82e9-e2967aa3535a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Deleting offline snapshot ca3a003a-69f8-468f-82e9-e2967aa3535a of volume 4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] snapshot_file for this snap is: volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1312c50-9788-4cad-b660-4fc346631996]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a Sep 23 00:36:48 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4757bcff-2d0f-4633-bf93-ab941df5b068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[63487c9d-1658-4162-aacc-b136e3f88947]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:48 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 Sep 23 00:36:49 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068" returned: 0 in 0.430s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a Sep 23 00:36:49 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a" returned: 0 in 0.380s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a Sep 23 00:36:49 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:49 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:49 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068.ca3a003a-69f8-468f-82e9-e2967aa3535a" returned: 0 in 0.296s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-ca3a003a-69f8-468f-82e9-e2967aa3535a" released by "_delete_snapshot" :: held 1.660s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" released by "delete_snapshot" :: held 1.688s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Created reservations ['ac140bda-f60a-479e-a37c-0dd505802d5f', '7d217038-9c75-44e7-a5f6-3b794544ce27', '3e6ac2ba-2aab-4633-a595-abdcf72cecf0', '68dd80f1-fa80-4abd-8b09-d018cfcf4a3b'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:50 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.306s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG oslo_service.periodic_task [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] Running periodic task VolumeManager._thread_info {{(pid=87132) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread count: 28 {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-c9627c95-5e30-45b1-96a8-7d973d96f837 None None] thread info: [<_MainThread(MainThread, started 126861252403328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87132) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:36:50 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Delete snapshot completed successfully. Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-971b7473-54d7-4306-bd06-8a305127903b tempest-ProjectReaderTests-495903578 None] Lock "cinder-ca3a003a-69f8-468f-82e9-e2967aa3535a-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-4757bcff-2d0f-4633-bf93-ab941df5b068-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "cinder-4757bcff-2d0f-4633-bf93-ab941df5b068-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a11cd5-9f92-420c-aaa7-6bb7ac495b0e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:50 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 Sep 23 00:36:50 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068" returned: 0 in 0.428s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068 Sep 23 00:36:51 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-4757bcff-2d0f-4633-bf93-ab941df5b068" returned: 0 in 0.275s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-4757bcff-2d0f-4633-bf93-ab941df5b068" released by "delete_volume" :: held 0.769s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Created reservations ['572cec6e-7b16-426f-a5e5-c069f35f8d54', 'da881a61-e058-40a4-b10d-98e22cc7cd4b', 'd5dc0ba9-7ec5-4fac-a75c-b45f5dd476bb', 'b1780a30-e19e-4ceb-83d6-9875e78ca550'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:36:51 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.313s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:51 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Deleted volume successfully. Sep 23 00:36:51 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-5141be12-d273-4583-beec-df8066c83afa tempest-ProjectReaderTests-495903578 None] Lock "cinder-4757bcff-2d0f-4633-bf93-ab941df5b068-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (54206bb9-2280-4442-81c1-bfa36181a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fb80ac-6e8a-42d1-b48c-625546d641ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fb80ac-6e8a-42d1-b48c-625546d641ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352222904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036576da-0676-40ff-bf0b-4319e8f0aa45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:52Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77662b94-369e-4f82-b3ab-3e4a6d0cb439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77662b94-369e-4f82-b3ab-3e4a6d0cb439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2f65ff-ff42-4fe5-aeb4-8d2e4f51287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2f65ff-ff42-4fe5-aeb4-8d2e4f51287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036576da-0676-40ff-bf0b-4319e8f0aa45', 'volume_name': 'volume-036576da-0676-40ff-bf0b-4319e8f0aa45', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea33f64-d8c2-48b5-94ec-8748f783be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea33f64-d8c2-48b5-94ec-8748f783be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa2069-6cda-47fe-9e59-dd95dafb19dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:52 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Volume 036576da-0676-40ff-bf0b-4319e8f0aa45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036576da-0676-40ff-bf0b-4319e8f0aa45', 'volume_size': 1} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352222904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036576da-0676-40ff-bf0b-4319e8f0aa45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:52Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Creating volume 036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:52 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 1073741824 Sep 23 00:36:52 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 1073741824" returned: 0 in 0.467s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 Sep 23 00:36:52 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45" returned: 0 in 0.267s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fa2069-6cda-47fe-9e59-dd95dafb19dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036576da-0676-40ff-bf0b-4319e8f0aa45', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e8f4f7-15b5-4788-ac20-88dc0db2e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:53 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Volume volume-036576da-0676-40ff-bf0b-4319e8f0aa45 (036576da-0676-40ff-bf0b-4319e8f0aa45): created successfully Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e8f4f7-15b5-4788-ac20-88dc0db2e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:53 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (54206bb9-2280-4442-81c1-bfa36181a90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:53 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-e1838495-630f-4433-88ad-1334b917c097 tempest-ProjectReaderTests-495903578 None] Created volume successfully. Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Creating offline snapshot a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 of volume 036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab95baaa-6f6a-4852-9f8c-4a74e4f82301]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 Sep 23 00:36:54 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:55 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 1G Sep 23 00:36:55 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 1G" returned: 0 in 0.433s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036576da-0676-40ff-bf0b-4319e8f0aa45 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:55 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036576da-0676-40ff-bf0b-4319e8f0aa45 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 Sep 23 00:36:55 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036576da-0676-40ff-bf0b-4319e8f0aa45 -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" returned: 0 in 0.334s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 is being set with open permissions: ugo+rw Sep 23 00:36:55 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:55 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 Sep 23 00:36:55 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" returned: 0 in 0.285s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info Sep 23 00:36:56 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info is being set with open permissions: ugo+rw Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info Sep 23 00:36:56 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.info" returned: 0 in 0.264s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:56 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-9d702b29-bc47-47ed-bf79-31e5ce0bea83 tempest-ProjectReaderTests-495903578 None] Create snapshot completed successfully Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Deleting offline snapshot a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 of volume 036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] snapshot_file for this snap is: volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a03dd4-c611-4017-9835-ba6f0d95f7a1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:57 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 Sep 23 00:36:57 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:58 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" returned: 0 in 0.437s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036576da-0676-40ff-bf0b-4319e8f0aa45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6015cbb-fffc-4472-8fe4-4022087ad772]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 Sep 23 00:36:58 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:58 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45" returned: 0 in 0.405s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 Sep 23 00:36:58 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" returned: 0 in 0.374s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:59 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6 Sep 23 00:36:59 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45.a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6" released by "_delete_snapshot" :: held 1.588s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" released by "delete_snapshot" :: held 1.612s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Created reservations ['be165a48-7375-4100-9181-2f1329cd4f8f', 'dfc6edfa-c533-4b0f-9acc-326d082cb007', 'be75c7ac-9d4a-4604-97a2-f34143986a5e', 'ec3b4c94-c1aa-4b10-88b9-c7afb357036a'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:36:59 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Delete snapshot completed successfully. Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-247165b9-d21d-424a-9daf-d21e3249c34a tempest-ProjectReaderTests-495903578 None] Lock "cinder-a5ad897d-141e-4bc3-912c-1b51e9bc0ef6-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-036576da-0676-40ff-bf0b-4319e8f0aa45-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "cinder-036576da-0676-40ff-bf0b-4319e8f0aa45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" acquired by "delete_volume" :: waited 0.017s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:59 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[a972cd74-0af4-4539-ab80-b2699c3eec69]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 Sep 23 00:37:00 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45" returned: 0 in 0.399s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45 Sep 23 00:37:00 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-036576da-0676-40ff-bf0b-4319e8f0aa45" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-036576da-0676-40ff-bf0b-4319e8f0aa45" released by "delete_volume" :: held 0.725s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Created reservations ['3f0b9f6e-595c-421d-a04c-91daaefb12da', 'd9c9afc4-7e78-4ba0-9b0e-2baf0e7ca1ee', 'c369e394-7830-40bc-9dc4-5f4e4b3ee05f', '4e88b26b-dd35-4bbe-b602-ca09b08a522f'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:00 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:37:00 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:01 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.278s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:01 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Deleted volume successfully. Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-78e20d92-3959-4961-8999-38edbbd64126 tempest-ProjectReaderTests-495903578 None] Lock "cinder-036576da-0676-40ff-bf0b-4319e8f0aa45-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87132) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (f00d1269-9aaf-42ab-acb1-cf6edfee793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190a1169-58c1-4d3b-b5ea-43a7b2024083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190a1169-58c1-4d3b-b5ea-43a7b2024083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956301596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db4a1a-8fcd-4125-9e4c-c57ef198216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe76c6f-533d-4895-88e7-8afa4427c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe76c6f-533d-4895-88e7-8afa4427c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144a562a-09f9-4bf1-b223-e6005f62644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144a562a-09f9-4bf1-b223-e6005f62644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16db4a1a-8fcd-4125-9e4c-c57ef198216d', 'volume_name': 'volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edf7ffe-3976-47de-8120-20b1b82147e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edf7ffe-3976-47de-8120-20b1b82147e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e4d75-b708-4451-abb8-239922627c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Volume 16db4a1a-8fcd-4125-9e4c-c57ef198216d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d', 'volume_size': 1} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956301596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16db4a1a-8fcd-4125-9e4c-c57ef198216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a71e38871148a6a35cf8d2de5a66ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='91826f060a5241ab928d79e0a6ddbb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(694f9317-d089-4324-9056-3ae18bec0643),volume_type_id=694f9317-d089-4324-9056-3ae18bec0643)}" {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Creating volume 16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Selected osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 as target Quobyte volume. {{(pid=87132) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:01 devstack cinder-volume[87132]: INFO cinder.volume.drivers.remotefs [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] casted to osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075 Sep 23 00:37:01 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d 1073741824 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:01 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d 1073741824 Sep 23 00:37:01 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d 1073741824" returned: 0 in 0.421s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d Sep 23 00:37:02 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d" returned: 0 in 0.246s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'} {{(pid=87132) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e4d75-b708-4451-abb8-239922627c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d', 'volume_size': 1}' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9c6cf1-a4b9-4ec0-9ff0-d886870a0ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:02 devstack cinder-volume[87132]: INFO cinder.volume.flows.manager.create_volume [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Volume volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d (16db4a1a-8fcd-4125-9e4c-c57ef198216d): created successfully Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9c6cf1-a4b9-4ec0-9ff0-d886870a0ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87132) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Flow 'volume_create_manager' (f00d1269-9aaf-42ab-acb1-cf6edfee793d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87132) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:02 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-ccf890e3-6af7-4861-96b8-11da3f85219d tempest-ProjectReaderTests-495903578 None] Created volume successfully. Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Creating offline snapshot d8e89d8d-b100-467a-b822-393a7df2f7c4 of volume 16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67f942-0aa8-4a1f-a5d1-78931611fe30]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:02 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d Sep 23 00:37:02 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d" returned: 0 in 0.397s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 1G {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 1G Sep 23 00:37:03 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 1G" returned: 0 in 0.438s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 Sep 23 00:37:03 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d -F qcow2 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4" returned: 0 in 0.335s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 is being set with open permissions: ugo+rw Sep 23 00:37:03 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 Sep 23 00:37:03 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4" returned: 0 in 0.270s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info Sep 23 00:37:04 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info" returned: 0 in 0.280s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[87132]: WARNING cinder.volume.drivers.remotefs [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info is being set with open permissions: ugo+rw Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info Sep 23 00:37:04 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.info" returned: 0 in 0.265s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:04 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-bc6971e3-5df2-4c47-a61c-4a5846409ac9 tempest-ProjectReaderTests-495903578 None] Create snapshot completed successfully Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-d8e89d8d-b100-467a-b822-393a7df2f7c4-delete_snapshot" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-d8e89d8d-b100-467a-b822-393a7df2f7c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" by "delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-d8e89d8d-b100-467a-b822-393a7df2f7c4" by "_delete_snapshot" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-d8e89d8d-b100-467a-b822-393a7df2f7c4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Deleting offline snapshot d8e89d8d-b100-467a-b822-393a7df2f7c4 of volume 16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] snapshot_file for this snap is: volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[284bd8a6-3be4-475c-9c7f-53d42d15fce9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:05 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 Sep 23 00:37:06 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4" returned: 0 in 0.382s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.remotefs [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87132) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf78cc50-ede2-47db-8a4e-ce51ff9d8868]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d Sep 23 00:37:06 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d" returned: 0 in 0.372s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 Sep 23 00:37:06 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4" returned: 0 in 0.357s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4 Sep 23 00:37:07 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d.d8e89d8d-b100-467a-b822-393a7df2f7c4" returned: 0 in 0.263s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-d8e89d8d-b100-467a-b822-393a7df2f7c4" released by "_delete_snapshot" :: held 1.476s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" released by "delete_snapshot" :: held 1.501s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Created reservations ['341ce7c2-ce5f-4088-8e08-eca9060365b9', '2ecb790e-dda0-442d-9842-11d13c36b3b3', 'bdafd9fa-fe98-42e2-983a-cad5ef11cca8', '44df9b89-0d4e-451c-b87f-b90b6918fe83'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:37:07 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Delete snapshot completed successfully. Sep 23 00:37:07 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-12112907-71a6-4076-b980-a2ee3e9042b4 tempest-ProjectReaderTests-495903578 None] Lock "cinder-d8e89d8d-b100-467a-b822-393a7df2f7c4-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-16db4a1a-8fcd-4125-9e4c-c57ef198216d-delete_volume" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "cinder-16db4a1a-8fcd-4125-9e4c-c57ef198216d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Acquiring lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" by "delete_volume" {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" acquired by "delete_volume" :: waited 0.019s {{(pid=87132) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f649d-3f70-4081-bd1a-4dc6845aab59]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d Sep 23 00:37:08 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d" returned: 0 in 0.361s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d Sep 23 00:37:08 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f/volume-16db4a1a-8fcd-4125-9e4c-c57ef198216d" returned: 0 in 0.255s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "cinder-quobyte-16db4a1a-8fcd-4125-9e4c-c57ef198216d" released by "delete_volume" :: held 0.680s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.quota [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Created reservations ['d1c84c5c-bf3c-4192-9eb6-401dc1a7dc10', '2e0c9ae0-3868-4863-8443-2cc8158900d1', '62f94b1d-8e3d-4555-ae2f-e16eddd8cd09', '71298c2c-a949-4ccf-a688-76af7e37b224'] {{(pid=87132) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075': None} {{(pid=87132) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG cinder.volume.drivers.quobyte [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a4afb3fe-c0ca-4477-9e51-7126017cd075'] {{(pid=87132) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.lockutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87132) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:08 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f Sep 23 00:37:08 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87132]: DEBUG oslo_concurrency.processutils [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d77658fbfb7d7979e2e14a99f5e23f" returned: 0 in 0.294s {{(pid=87132) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87132]: DEBUG cinder.manager [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Notifying Schedulers of capabilities ... {{(pid=87132) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:09 devstack cinder-volume[87132]: INFO cinder.volume.manager [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Deleted volume successfully. Sep 23 00:37:09 devstack cinder-volume[87132]: DEBUG cinder.coordination [None req-8465defc-4ceb-493a-a104-e23329ffbd92 tempest-ProjectReaderTests-495903578 None] Lock "cinder-16db4a1a-8fcd-4125-9e4c-c57ef198216d-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87132) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:18 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=63,cinder:UPDATE=92,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:19 devstack cinder-volume[87132]: DEBUG dbcounter [-] [87132] Writing DB stats cinder:SELECT=76,cinder:UPDATE=87,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87132) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}